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INTRODUCTION 


GENERAL INFORMATION 


Statistics, Volume 4 is a collection of nine programs directed toward regression analysis 
problems not treated in Statistics, Volume 3. The Volume 4 package is versatile because 
subroutines written by the user permit equations to be tailored to specific applications. The 
entire force of the software can be focused on particular problem types, no matter how unique. 


Statistics, Volumes 3 and 4 are complementary. Together, they provide the means to solve 
complex regression problems, both linear and non-linear. Thorough coverage of the 
regression topic is thus provided. 


The Statistics, Volume 4 package consists of the programs, pre-recorded on magnetic tape; 
two overlays for the Graphic System User-Definable keys; and this manual. 


The user should have access to information contained in the following manuals: 


 ] TITLE TEKTRONIX PART NUMBER 
= 4051 Graphic System Operator's Manual 070-1940-XX 
4051 Graphic System Reference Manual 070-2056-XX 
Plot 50: Introduction To Programming in BASIC 070-2058-XX 
Plot 50: Introduction to Graphic Programming In BASIC 070-2059-XX 
4051R01 MATRIX FUNCTIONS Instruction Manual 070-2127-XX 


PROGRAM CONTENT 


Marquardt’s Nonlinear Least Squares and Gauss-Newton Nonlinear Least Squares programs 
treat nonlinear regression problems by applying general user-defined functions. A function 
Minimization program provides realistic starting values for parameters required by both 
problem-solving programs. 


The Nonlinear Systems Of Equations programming consists of a subroutine to solve nonlinear 
equation systems, a program to use the subroutine, and a sample user-written subroutine to 
specify the system of equations. 


The Exponential Least Squares and Exponential One Knot Spline programs use two 
commonly occurring specific functional forms to solve nonlinear regression problems. 


SN RIND Pern Me a ae 


HN 
é Piecewise polynomials are fit to data by the Cubic Spline program, and the Fourier Regression 
program allows regression to be fit to cyclical data. : 
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A Linear Regressions program completes the package. With 24 pre-defined transformations, 
this program fits linear regressions to data, and is especially useful for designing equations to 
represent experimental data, or data from tables. 


HARDWARE REQUIREMENTS 


A Tektronix 4050-Series Graphic System with 16k bytes of memory will permit execution of all 
programs except Linear Regression (program number 9). The Linear Regression program 
requires 32K memory. A TEKTRONIX 4051R01 MATRIX FUNCTIONS ROM Pack is necessary 
for execution of program 1, and for the least squares method of program 7. 


MAGNETIC TAPE DATA STORAGE 


Input data, entered from the keyboard, can be stored on magnetic tape files. Data can be 
corrected, and can be added to or deleted from data files, either in machine memory, on 
magnetic tape, or both. Data is stored on tape in Binary format. 


Data storage is a function of Statistics, Volume 4 programs, and is initiated by a User-Definable 
key. Tape files must be pre-marked as described in the Graphic System Reference Manual. 
(See the MARK statement explanation.) 


Correction of data on tape is accomplished by reading the file into memory (FROM TAPE key); 
making the changes, additions, or deletions; and saving the file to tape again (TO TAPE key}. 


If data files are stored on separate data tapes, tape cartridge changing will be required during 
program execution. All such necessary cartridge changes will be indicated by a displayed 
message. 


To create a magnetic tape data file, or to read a file from tape, without invoking the Statistics, 


Volume 4 software, the following instructions can be entered. The magnetic tape Read/Write 
Head must be positioned at the proper tape file. 


When N represents the number of data pairs (or triplets, etc.) and XiYi represents a data pair, 
magnetic tape data format can be visualized as 


IN [XY [V2 [Ys fw | XeVo 
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TO WRITE DATA TO TAPE 
100 WRITE N 

110 FORI=1TON 

120 WRITE X(I), Y(I) 

130 NEXT | 


NAO WwHHAlwes 


TO READ DATA FROM TAPE 
200 READ @33: N 

210 FORI=1TON 

220 READ @33: X({I), Y(I) 
230 NEXT | 


te NR RE te a el a A 





eee ee eee 


3NO WVHDOUd 


GRAPHIC DISPLAY OUTPUT 


Except for programs 3 and 4, every program on.the menu generates graphic displays. Q9,a.. 
variable in each program's coding, designates the device address to which the graphics 
displays are sent. The assigned value, 32, designates the crt display screen as the recipient. 


ee eee 


To designate another device (a plotter, for example), change the Q9 vajue to co rrespond to the 

address of the selected display device. This is accomplished by keying “Q9=nn” after the 

program has been initialized. nn represents the appropriate address. Since no line number is 

entered, the assigned Q9 value will be retained until another program is loaded or until the 
= INITIALIZE key is pressed. 4 





Variable QO represents the number of line segments used to plot functions, and has a value of 
400 at initialization. The QO value can also be changed, using the technique just described. 


PAGE FULL CONDITION 


When the display screen has no more lines available, a PAGE FULL condition occurs and 
processing is delayed until the screen is cleared. The condition is indicated by a flashing F in 
the upper left corner of the display screen. Normally, this requires use of the HOME PAGE key, 
but the machine “behavior pattern” can be altered. With the machine idle (not engaged in 
program execution), type one of the following entries: 


OML WVHDOd 


To clear the screen (PAGE) automatically, whenever the screen lines are filled, type 
PRINT @32,26:2. 


To execute a COPY command, and clear the screen whenever PAGE FULL occurs, type 
PRINT @32,26:3. 


To cause reversion to the original condition, type PRINT @32,26:0, or turn the machine OFF. 


AHH! WYHOOHA 
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FROM TAPE (Key #11) 


This key permits a data file to be read from magnetic tape. The specified tape data file replaces 
any data already in memory. Required initialization information is requested in the sequence 
shown in each program's operating procedure chart. 


{ 
a) 
8 
Program #9, Linear Regressions, uses overlay #2. > 
a & 
7“ 
° 
LINEAR REGRESSIONS TAPE 1 S 
See 2 Re os Sah ¥ magi, UE Be. te Pes rie Aisne ae aed jaggy oe ever abet Bae ree Fa ak mers i 
Bie aes a Re . Sy ' 
| CHANGE DELETE LIST SET SET < 
ager DATA DATA F(X) & GLY) SCREEN OFFSET 1 
a ae 
Bs _ . 
8 
we é ENTER § ADD LIST CURRENT [J CURRENT 
Pe DATA DATA DATA SCREEN OFFSET 
i be 7: on # ' dye” Seotitok tod tye ite , 7 BE eed. ; 
ee &B Ceres er areas: rage gh ee poten SERIES BE OPS Ss es 
Gq SHIFT KEYS Re 
"eo" TAPE COLLECTED CURRENT REMOVE REMOVE xa - 
ne BP DATA PARAMETER F(X} & GtY} SCREEN OFFSET ae wh 
- ms 
a | ea ae oe 3 
S rede 4 ie] 
; RB FILTERED % SELECT fR SELECT . on + @ 
PLOT = PARAMETER PARAMETER F(X) ;  3=oGM) = | Fg 
P. roe mrt | £ 
i © 
i 3 
: Mm 
Program 3 responds to INITIALIZE (key #1) only, and does not require keyboard overlays. 
Program 4 is executed by typing RUN. 
After required program initialization procedures are completed, User-Definable keys can be 
used in any sequence. ‘ 
iN 
Those keys whose operations are similar during execution of programs 1, 2, 5, 6,7, and 8 are i 
described in this section. The INITIALIZE, FROM TAPE, and SOLVE key operations are i 
dependent upon the program being executed, and are further described in each applicable 
program section. 
-t2 
ans 
Key usage for the Linear Regression program is described in the Program Nine section. i | © 
te 
‘1s 
-tO 


Neon oe 


33uH1 WYYUDOUd 


ee ar 
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TO TAPE (Key # 12) ; 


The data in memory is stored to a previously marked data file, designated by the user. Data 
previously stored to that tape file is destroyed, but the data remains unchanged in machine 
memory. 


DATA TO TAPE 


INSERT DATA TAPE AND ENTER THE TAPE FILE NUMBER = 9 
PUT PROGRAM TAPE BACK IN} 





Anerror will occurifan ASCII file is designated for Binary format storage. To override the error 
and destroy the ASCII data, enter KILL nn (the file number), and press TO TAPE again. 


DELETE ANY (Key #13) 
The DELETE ANY key is used to selectively delete data in memory. 


When the key is pressed, a program loop is entered and any number of data points can be 
deleted. As each data point is deleted from memory, remaining data points are renumbered 
“top to bottom”, to close the gap. !f more than one data pointis to be deleted, enter the points in 
descending numerical sequence to prevent errors in the renumbering process. 


ait 


E 
a 
re 


DELETE DATA 


re 
ie 


ENTER THE POINT NUNBER # 7 


iE 
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as CORRECT ANY (Key #14) 


The CORRECT ANY key allows alteration of X or Y variables. Present values of the specified 
data point are displayed. 


CORRECT DATA 


ENTER THE POINT NUMBER = 5S 
EeEeeNLverurs 


Xl = 2 
Y # 321 

ENTER VAR. @ (@ FOR Y> TO BE CORRECTED (OR PRESS "RETURN" #8 
ENTER WEN Y = 311 





INITIALIZE (Key #1) 


When an executable program is in machine memory, the INITIALIZE key is used to enter data 
and to provide information for program control. 


Fa During keyboard entry, data values can be separated by aspace, comma, alphabetic character, 
. or arithmetic operator (1, /, +,*, or —). Ifa minus sign (—) is used, the number following will be 
negative. 


RESUME (Key #2) 

Additional data points can be added to the data in memory when this key is pressed. The key 
can be used at any time after initialization has been completed. Added data points will be 
numbered sequentially, starting with the next higher number. 


DELETE LAST (Key #3) 

The highest numbered data point is deleted from the data file in memory when this key is 

pressed. Repeated use will cause points to be deleted in descending numerical sequence. As 
each data point is deleted, the point number is displayed and keyboard entry of new data is 

permitted. If new data is entered, the data point number will be incremented by one after each 
entry, until another key is pressed. 
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CORRECT LAST (Key #4) 


During execution of programs 5, 6, 7, and8, this key causes action similar to that described for 
the DELETE LAST key. For programs 1 and 2, values for the highest numbered data point are 
displayed when this key is pressed. New values can be entered, or current values can be 
retained by pressing RETURN with no entry. 


PRESENT VALUE: 
x1 = 65 
Y #3 


ENTER VAR. @ (@ FOR Y) TO BE CORRECTED (OR PRESS “RETURN"> #@ 1 
ENTER X1 = 68 





PRINT DATA (Key #5) 


All data currently in memory will be displayed. 


DATR POINTS 
Kl a‘ 
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PLOT RESIDUALS (Key #18) 


Residuals are defined as y minus they estimate. Your choice of X or Y canbe plotted against the 
residuals. The residuals are always the vertical axis. 


PLOT RESIOUALS 


PLOT THE RESIDUALS US. X OR Y CENTER X OR YD: Y 


INO MVHDOUd 


Y VS. RESIDUALS 





PUBA Ft severe ree? & 


ee en 
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RESIDUALS (Key #19) 


When this key is pressed, a table consisting of values of X, Y, Y estimate, and residuals (y - y 
estimate) is displayed. Parameters found in the SOLVE routine are used to calculate the Y 
estimates. 


RESIDUALS 
A1¢1) YI YI EST 
@,888080 4280. 080880 42008,020830 
3.800888 2022. 088088 2621.847726 
18.9880088 1033, 888888 1833.349898 


— 


RESIDUAL 
-8. 826836 
6.152274 
-B. 349896 
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1 
2 
3 
4 
5 
6 
? 
8 
9 


15. 880068 
20, 088988 
25. 888888 
38. 8088888 
35. 860888 
40. 808888 
45. 888888 
358. 890888 
69. 288888 


356. 688888 
311,.800886 
179.808808 
165. 880008 
62. 688888 
37. 888088 
22. 068888 
14.880806 

5.888888 


555. 793484 
316.933765 
178.894172 
104.885511 
62.249413 
37. 238482 
22, 373688 
13. 485813 
4.921646 


6.206516 
0.666225 
@. 185828 
@.114489 
-6.249413 
-8. 238482 
-8. 373686 
8.51498? 
6.878354 





PLOT 50: STATISTICS VOLUME 4 


io PLOT DATA (Key #6) 


Raw data from the data file in memory is plotted when this key is pressed. 


ARQUARDT’S LEAST SQUARES 


6.00 E+1 





SOLVE (Key #7) 


SOLVE, the routine performing the fit to data, is initiated by pressing this key. Description of 
the SOLVE procedure is contained in each applicable program section. 


The SOLVE routine can also be initiated by other User-Definable keys. If the operation of 
another key is dependent upon the fit performed by SOLVE, and if SOLVE has not been 
executed before the key is pressed, SOLVE will be invoked automatically. The action normally 
intiated by the key will begin when the SOLVE routine ends. 
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PLOT FUNCTION (Key #8) 


The PLOT FUNCTION key will cause a graph to be displayed, with each data point represented 
by an asterisk (x). The fitted function is then drawn to graphically illustrate the goodness of fit. 


MARQUARDT’S LEAST SQUARES 
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ESTIMATES (Key #9) 


The estimated Y value is computed for X values entered from the keyboard. A value must be 
entered for each independent variable, but parameter values are taken from the SOLVE 


routine. 
ESTIMATES 
ENTER X 
248,.557113854 
ENTER X 
24. 76551888034 
ENTER X 
8. 14224273483 
ENTER X 
7.36184611618 
ENTER X 
6.65658465814 
? ENTER 





PRINT PARAMETERS (Key #10) 


When this key is pressed, parameters found in the SOLVE routine are printed. 


PARAMETERS 


2622. 32182641 
8. 1808348856855 
2177. 69980385 
@.2800937195182 
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User-Definable keys call tape files into memory in accordance with Table 1-1. 


Table 1-1 
CALLED TAPE FILES 









Se en ee eS 
NUMBER KEY NAME TWO EIGHT 
; 39 
2 rResuME. | 3 | 11 | 20 =| 25 | 30 | 39 
3 Ae Le oe Bi 
LAST 
sell Wel Bl a Be 
LAST 
5 rPRINTDATA.|_3 | 11 | 20 | 25 | 30 39 
6 TpLoTDaTA.|_8 | 13 | 22 | 27 | 36 41 
6,7. 33,34, 
35. 
[ee [= | 
FUNCTIONS 
9 estimates |. 6 | 13 | 22 | 27 | 36 | 44 
PARAMETERS 
11 3 | a | 2 | 2 | 30 | 39 
12 _|TO TAPE 39 
13 |DELETEANY. | 3 | 11 [| 2 | 2 | 30 | 39 
14 TconRecTANY| 3 | 17 | 20 | 25 | 30 | 39 
Pl Ha Hl 
RESIDUALS 
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DATA REQUIREMENTS 


Throughout this manual, data input requirements are included in each program's Operating 
Procedure description. The procedures are defined in flow chart format to assist in planning, 
and to expedite program execution. Table 1-2 identifies symbols used in the Operating 
Procedure descriptions. 


Table 1-2 
OPERATING PROCEDURES SYMBOLS 





= Preparation and program loading. 





= Input through the keyboard is required. 





0 = A magnetic tape cartridge may need to be 
si changed. 








= Press the indicated User Definable key. 





= Internal processing occurs here. 





= A decision or choice of options must be made. 


6 = Off page connector. 
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Program One 


~ MARQUARDT’S NONLINEAR LEAST SQUARES 


PROGRAM DESCRIPTION 


This program, using the Marquardt least squares method, fits a user defined function to user 
data. The nonlinear function can support a large number of parameters, dependent upon the 
number of independent variables. Optimal parameter values are found by an iterative method, 
starting from a user specified point. 


A subroutine, written by the user to define the function, is required to calculate the function 
values only. The partial derivatives are numerically evaluated. 


For most problems, the local and global convergence properties resulting from program 
execution generally surpass those of the Gauss-Newton iteration method. However, 
parameter convergence is to a local least squares minimum, and a global best solutionis nota 


certainty. 


9 METHODS 


A maximum-neighborhood algorithm interpolates between the steepest-descent and Gauss- 
Newton algorithms. The interpolation is controlled by the value of the lambda parameter. 


The Marquardt method varies lambda at each iteration by multiplication or division by 10 only, 
but this program permits a choice of multiplier/divisor values. Additionally, the modified 
strategy proposed by Tabata and Ito can be used to reduce execution time for some problem 


types. 


THE SUBROUTINE 


The subroutine to calculate the function must start at line 1100 and must not go beyond line 
1800. Any variables not designated in the Program One Variables list can be used. 


To illustrate the subroutine entry procedure, variable Y1 and arrays X(I,Jj) and C(N) are used to 
evaluate the user function. 


Y1 = the function value calculated by the user subroutine; 
X(I,N1) = the N1 independent variables, X({I,1),X(1,2), ..., X(I.N1); and 
C(N) = the N parameter values for which we are solving, C(1), C(2), ..., C(N). 
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if the model is y = ax’ + b log (gx), 


C(1) =a; ( 
C(2) = b; 
C(3) = g: 

X(1,1) = x; and 

Yl=y. 


Variable | is passed to the subroutine to indicate the i'th data point. The variable to be 
calculated is Y1. 


Enter the coding as follows: 
1100 Y1 = C(4) * X(1,1)t2 + C(2) * LGT (C(3) * (1,1)) 
1110 RETURN 


The user function may utilize more than one line, as in the triple exponentiation model: 
Y = atb * EXP(—d * x)+e * EXP(—f * x)+g * EXP(—h * x). 
Ci=a; c2=b; c3=d; c4=e; c5=f- c6=g; and c7=h. 


X(1,1)=x. 
Y1=y. 


Enter the coding as follows: 


1100 Y1=c(1)+0(2) * EXP(—c(3) + x(I,1))+e(4) * EXP(~c(5) * x(I,1)) ( 
1110 Y1=¥1+c(6) * EXP(—c(7) « x(1,1)) 
1120 RETURN 


PROGRAM EXECUTION 


Press INITIALIZE (key #1) or FROM TAPE (key #11) to begin initialization as shown in the 
Operating Procedures chart. 


NOTE 


PROGRAM EXECUTION REQUIRES A 4051R01 MATRIX ROM PACK. 





1-2 @ 
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OPERATING PROCEDURES PROGRAM ONE 


LOAD PROGRAM NUMBER ONE 











ENTER YOUR SUBROUTINE 





| 









DATA FROM TAPE ? KEY #171 






INSERT 
DATA 
TAPE 






KEY #1 








HOW MANY INDEPENDENT VARIABLES ? 


i 


| HOW MANY PARAMETERS ? 


FILE NUMBER ? 












HOW MANY INDEPENDENT VARIABLES ? 


7 a 2 { See etaet 
HOW MANY PARAMETERS ? 
CALCULATE AND DISPLAY THE MAXIMUM 

NUMBER OF DATA POINTS ALLOWABLE 


Y 


READ DATA FROM TAPE 














CALCULATE AND DISPLAY THE MAXIMUM 
NUMBER OF DATA POINTS ALLOWABLE 












ENTER X-Y DATA 























INSERT 
PROGRAM 
TAPE 









PROCESS DATA. PRESS USER 
DEFINABLE KEYS 
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INITIALIZE (Key #1) 


When INITIALIZE is pressed, the numbers of independent variables and subroutine 
parameters must be entered through the keyboard. The program will then calculate and 
display the number of data points which can be accommodated by the machine. Data should . 
then be entered as shown in the DATA ENTRY description. 


% 


MARQUARDT’S NONLINEAR LEAST SQUARES FIT 


INITIALIZATION: 


HOW MANY INDEPENDENT VARIABLES (41,X42,ETC.> = 1 


HOW MANY PARAMETERS ARE THERE IN YOUR FUNCTION 


WHITH YOUR 


a 
a2 
#3 
#4 
#5 
#6 
#7 


#2 
#3 


ENTER 
ENTER 
ENTER 
ENTER 
ENTER 
ENTER 


ENTER: 
ENTER 


ENTER 


32K 
XV 
Xs 
4y¥ 
Xs 
Ky 
AsV 
Xs 


AsV 


Ky 


? 


MACHINE YOU CAN HAVE UP TO 216 OATA POINTS. 
= 68,3888 


, 208333, 3474. 342275 

. 416666, 3185. 758139 

. 625, 2929. 798819 

, 833333, 2702.53421 7 
1.041666, 2508, 563452 

1.25, 2320. 874398 

1.458333, 2160.830824 

1.666666, 2018. 118388 


416 ENTER X,Y = 1.875,1898. 704441 


1-4 


A 


@ PLOT 50: STATISTICS VOLUME 4 





— FROM TAPE (Key #11) 


This key permits data to be read from an existing magnetic tape data file. The procedure is 
similiar to INIT except that tape changing may be required. When the file has been read into 
memory, deletion, alteration, or addition of data points can be accomplished by appropriate 
User-Definable keys. 


DATA FROM TAPE 


INSERT DATA TAPE AND ENTER THE TAPE FILE NUMBER = 27 


MARQUARDT’S NONLINEAR LEAST SQUARES FIT 


INITIALIZATION: CREQUIRED BEFORE DATA IS READ “FROM TAPE) 


HOW MANY INDEPENDENT. VARIABLES (X1,X%2,£TC.> = 1 

HOW MANY PARAMETERS ARE THERE IN YOUR FUNCTION = 7 

WITH YOUR 32K MACHINE YOU CAN HAVE UP TO 218 DATA POINTS. 
PUT PROGRAM TAPE BACK IN! 





DATA ENTRY 


In the following data entry example, independent variable x, is entered, followed by the y value. 
Values may be separated by a space, comma, alphabetic character, or arithmetic operator 
(1/*+—). When a minus sign is used, the number following the sign will be negative. 


The message nn DATA POINTS ENTERED — THE MAXIMUM POSSIBLE indicates that all 
available internal storage has been used. 


ENTER y = 2,083333,1776. 882953 
ENTER = 2.291666, 1674.843894 
ENTER = 2,5,1583.446475 
ENTER 3} = 2, 788333, 1581.395783 
ENTER ; 2.916666, 1427. 6223493 
ENTER = 3.125,1361. 184289 
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PLOT DATA (Key #6) : 


HRQUARDT’S LEAST SQUARES 





SOLVE (Key #7) 
The SOLVE routine is entered by pressing the SOLVE key, or, if the routine has not been a 
executed since data entry, by pressing PLOT FUNCTION, ESTIMATES, or PRINT 
PARAMETERS. Execution of the routine causes tape file #4 to be appended at line 2000, and 


tape file #5 at line 3000. 


Information needed for SOLVE is requested and entered by sequential question display. 
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MARQUARDT’S NONLIHEAR LEAST SQUARES FIT 


YOU HAVE YOUR CHOICE OF TWO CONVERGENCE CRITERION. YOU MAY 
CHOOSE NEITHER, ONE, OR BOTH OF THEM. ENTER 8 FOR NO CONTROL: 


1. STOP WHEN THE CHANGE IN RESIDUAL SUM OF 
SQUARES IS LESS THAN CEG. 1E-4> = 1E-6 


2. STGP WHEN THE RELATIVE CHANGE IN EACH 
PARAMETER IS LESS THAN CEG. 1E-5> = 1£-6 

ENTER THE INITIAL VALUE FOR 
MARQUARDT’S INTERPOLATION FACTOR, Lambda CEG. 8.1> = .1 
Lambda IS MULTIPLIED AND/OR DIVIDED BY Nu. WARQUAROT KEPT Nu CONSTANT 
AT 10. YOU MAY KEEP Nu CONSTANT OR USE A “MODIFIED STRATEGY” (WHICH 1S 
USUALLY BETTER) IN WHICH THE PROGRAM VARIES Nu AUTOMATICALLY BASED ON 
CHANGES IN THE RESIDUAL SUM GF SQUARES FOR THE PREVIOUS 3 ITERATIONS. 
OO YOU WANT TO USE THE “MODIFIED STRATEGY": NO 


ENTER THE WALUE FOR Hu CEG. 14> = 18 


ENTER THE MULTIPLIER USED TO INCREMENT 
THE URLUES OF THE PARAMETERS (EG. @.61> = .@1 





If the “Modified Strategy” is not elected, a value for Nu will also be requested. 


A 
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ENTER VALUE FOR NU 


SOLVE ROUTINE PROGRAM ONE 


ANGE. 
«IN RESIDUAL SUM OF SQUARES IS ae. fg 
LESS THAN ? — es, 









STOP CONVERGENCE WHEN RELATIVE 
©. CHANGE IN EACH PARAMETER IS 
ESSTHAN? 


























NITIAL LAMBDA VALUE 


VARIABLE OR CONSTANT ?) 
MODIFIED STRATEGY ? 






» ENTER MULTIPLIER TO INCREMENT | 
“PARAMETERS | 






RESIDUAL SUM OF SQUARES 
_. PRINTED ? 





YES 


NEW PARAMETERS PRINTED ? 


VES 


DETERMINANT PRINTED ? 


YES 







NO 


THE ANGLE PRINTED ? 


YES 


LUES : 









ENTER THE MAXIMUM NUMBER OF 
ITERATIONS . 


PROCESS AND DISPLAY 
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The amount of information displayed for each iteration is determi ned b 


y the user response to 
questions displayed when the SOLVE key is pressed. 


DO YOU WANT THE RESIDUAL SUM OF SQUARES PRINTED AT EACH ITERATION: YES 
DO YOU ALSO WANT THE NEN VALUE OF THE 


PARAMETERS PRINTED AT EACH ITERATION: YES 


00 YOU ALSO WANT THE DETERMINANT PRINTED 
AT EACH ITERATION ITERATION: NO 





A"NO" response to any question above will cause the remaining questions to be omitted, with 
a “NO” response assumed. 


INITIAL PARAMETERS 


han 6 seek nee me 


Marquardt’s nonlinear least squares program requires initial values for parameters C(1), 
C(2),...,C(N). Accurate initial estimates permit a faster solution because fewer iterations will be 
required. If initial parameter values are poor, the program may never converge. 


The initial sum of squares printed by the program is an indicator of parameter validity. Good 


initial parameter values will result in smaller sum of Squares value, and inaccurate parameter 
values will result in larger initial vatue. 





Program Three, the Nelder and Mead Function Minimization Program, can frequently be used 
to optimize initial parameter values, saving considerable time. 


ENTER THE INITIAL VALUES FOR THE PARAMETERS: 
@i 40@ 

#2 1458 

#3 «445 

G4 675 

#5 «8.88 

a6 

«? 


OML WVYHDOUd 


y_N 


ENTER THE MAX. NUMBER OF ITERATIONS ALLOWED = 259 





Starting parameter values are needed, and accurate selection of their values will reduce 


iteration requirements. If valid parameter values are unknown, enter an arbitrary designation 
such as 0 or 1. 


a3yuHL WVYYDOkd 
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Eigenvalues of the moment matrix are displayed for the first iteration only. 


REGINNING ITERATIONS 


INITIAL SUM OF SQUARES = 466047. 486513 
ITERATION NCQ. 1 
EIGENVALUES OF THE MOMENT MATRIX: 


-5.587436505E-7 -2.375721664E-7  1516.83092356 6.19888205/7E-6 
8. 303742684E+7 6.33773981843 3998877. 38933 


SUM OF SQUARES = 7327.353 Lambda = 8.01 


NEW PARAMETERS: 
399, 878958036 
1496.62889326 
8.528744413357 
673.272492822 
6.0799018@112119 
1212.99206459 
@.6320566080492 


NOD CAA GIA 


ITERATION NO.2 
SUM OF SQUARES = 56.278 Lambda = 1.0E-3 


NEW PARAMETERS: 
408. 188599465 
1498.62852456 
@.516481863611 
683.022669144 
8.8922066754315 
1215.89191342 
@.667927731961 


NI CAS OTD 





Each iteration involves the solution of a system of equations, and the INV command in the 
MATRIX ROM Pack is used to greatly increase speed. If the system becomes singular, new 
parameter starting values must be entered. 


THE MATRIX HAS BECONE SINGULAR. 
TRY AGAIN WITH DIFFERENT STARTING VALUES. 
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v 
2 
©] 
ra 
Ft at ' eo . . . Dp 
A “singular matrix” is a matrix with no inverse. : 
3 
If convergence is not accomplished after the specified maximum number of iterations, four = 
. * i 
options are available: 
| 
SUM OF SQUARES = 9339. 60823133 
NO CONVERGENCE AFTER 4 ITERATIONS. 
YOU HAVE FOUR OPTIONS AT THIS POINT: 
1, USE THE CURRENT PARAMETER VALUES. 
2. TRY FIVE MORE ITERATIONS. 
3. ENTER KEW INITIAL VALUES FOR THE PARAMETERS. 
4. START THE MARQUARDT SOLUTION OVER FROM THE BEGINNING. 
ENTER YOUR CHOICE (15243, OR 4) # x 
° 
o 
P+) 
> 
= 
. . + s . mn 
When iterations are completed and convergence is accomplished, tape file #7 is appended at < 
line 3000. 
CHANGE IN SUM OF SQUARES (7,.502017293E-8) IS LESS THAN 1.@E~6 = 
TERMINATION AFTER 9 ITERATIONS. 
FINAL SUM OF SQUARES = 1.76?7983353E-? 
DF = 18 
SIGMA = 9.910441613E-5 
vu 
J PARAMETER ERROR 2 
1 408,159456225¢e 2. 18075335996 o 
2 1491.96145044 14, 32259889214 oe] 
3-8. 499285998262  6.69186834E9235 > 
4 699.43432015 6.494631511474 z 
$ @,0999810747105  &.568293377E-4 
6 1208,44953652 16.9764500377 z 
7? 0,699369287457 §.80105898311959 S 








DO YOU WANT TO SEE THE INVERSE MATRIX: YES 
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ROW f 
4.842825654E+8 


ROW 2 
3.145953128E+9 


ROW 3 
412436,682849 


ROW 4 
1. 862743504E+8 


oW S 
198822. 798446 
74.6098116751 


ROW 6 
+3. 736425263E+9 
~1478564. 75644 


ROW 7 
234723,.B872724 
92.414489€921 


INVERSE MATRIX 


2.08898B157E+10 


2722572. 74262 


7, 2B01754454E+8 


1238567.88°94 


-2,475507877E+18 
2. 934321831E+18 


1938959. 59696 
1847436. 27455 


355. 409496546 


93370. 4000115 


{62.238163961 


-3228376.62218 


203. 171793858 
116. 347131418 


2. 531473741 E+? 


41972. 5726862 


-8.517S598291E+8 


33755. 7379413 


DO YOU WANT THE PARTIAL CORRELATION MATRIX PRINTED: YES 


PARTIAL CORRELATION MATRIX 


he EE 


Seen nd Atle «Fhe PDF ae 


fete = 


te nt 


ONE Aa at RIA gy hh ll ere dN RRR a5 | AMI Et 
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ROW 1 
1 


ROW 2 

@. 989198332744 
ROW 3 

@. 994212520832 
ROW 4 

@. 959986692704 


ROK S 
@.999761767931 
i 


ROW 6 
8, 991262973562 
-6. 993881574397 


Ou 7? 
@. 989938745016 
@. 991896166836 


6.9992683539427 
@, 990359233852 


@. 992121936752 
ree 


0.999995885995 
-8. 999856684342 


@.994369144248 


8, 996306277686 


0. 999691857796 


@.599127841483 
t 


DETERMINANT OF MOMENT MATRIX * 8,0014545571062 


KEKDOHE RSE 


@. 96579117943 


-@, 988272175432 


@.998513216259 








PLOT 50: STATISTICS VOLUME 4 


PLOT FUNCTION (Key #8) 


ARQUARDT“S LEAST SQUARES 





& If the data contains more then one independent variable, an integer must be entered to specify 
which X variable is to be used for the horizontal axis. 


PLOT Y US K ? 


Values for other X variables must also be specified. 


WHILE VARYING Xn BETWEEN ITS DATA MIN AND MAX, HOLD X COHSTANT AT: 7 





Enter a value for each independent variable. 
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~ VARIABLES—PROGRAM ONE 


VARIABLE 
| 


10 

M 

MO, M1, M2, M3 
M4 


M5 
N 
NO 
N41 
N2 
N3 
N4 
NS 


N6 
N7 
N8 


N9 
P 


PO 
P1, P2, P3 
P4 
PS 
P6 
P7: 
P8 
P9 
P$ 
Q 
QO 


Qt 
Q2 
Q3 
Q4 
Q5 
Q6 


Q7 
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USAGE 


Data point number passed to user subroutine at line 1100.1 <I< 
(N+1) 

Scratch. 

The number of parameters to solve for. 

Scratch variables. 

1 = Parameters have been found; 0 = Parameters have not been 
found. — 

Scratch. 

The number of user data points stored in X and Y. 

Scratch. 

The number of independent variables. 

Initial lambda value in SOLVE. 

Current lambda value in SOLVE. 

Nu, the multiplier of lambda in SOLVE. 

Set to0 when Marquarat’s method is used in SOLVE. Any other value 
indicates modified strategy. 

The history of Sum of Squares changes in SOLVE. 

Scratch. 

An array. N8 (N1+1), used for the input of data points from the 
keyboard. 

P8 + 1. 

An array P(N1+1,2) for the minimums and maximums in user data 
points. 

An array, PO (8), used for graphing. 

Scratch variables. 

Residual sum of squares in SOLVE for this iteration. 

Residual sum of squares for the previous iteration. 

In SOLVE, stopping condition for sum of squares. 

In SOLVE, stopping condition for relative change in parameters. 
Maximum number of data points that can be stored in the X, Y array. 
Flag to indicate which User-Definable key was pressed. 

Scratch. 

Scratch. 

The number of line segments used to plot the function. Initialized 
value = 100. 

=N1 + 1. 

=M + 1. 

=N-+ 1. 

In SOLVE, the maximum number of iterations. 

In SOLVE, the number of iterations completed. 

In SOLVE, controls the amount of information printed at each 
iteration. 

Scratch, in SOLVE. 
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PROGRAM SIX 
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Program Two 


~ GAUSS-NEWTON NONLINEAR LEAST SQUARES 


PROGRAM DESCRIPTION 

This general program performs a least squares fit of a user defined function. The function can 
depend upon any reasonable number of parameters and can be nonlinear. Parameter 
convergence is to a local least squares minimum, and a global best solution is not guaranteed. 


Data can have an arbitrary number of independent variables. 


METHODS 


Optimal function parameter values are found by the Gauss-Newton iteration method, starting 
from a user specified point. The method determines parameter C(j) to minimize the residual 
sum of squares, where j=1 to M, the maximum number of parameters. 


The residual sum of squares is equal to: 


X  [Y¥,— Func (X%, C)]’. 
i=1 


N = the number of user data points; 
Xi = i'th independent variable(s); 
Y,  =i'th observation; and 


Func = user function evaluated at X; for parameter values C. 


At each iteration, an M by Msymmetric linear system of equations is formed and solved. The 
solution yields the change in the vector C, until the change in each component of Cis less than 


the user specified quantity. 


G * (change in C) =R 
G =M by M matrix: 
R = M-column vector. 


N 


G(J,K) = £ Cii(J)*C1,(K), and 
i=1 


N 
@ R(J) = = Cr(J)*[¥; — Func (%, C)] 
= i=1 


2-1 
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. < in the following example, variable ¥1 and array CI are calculated. Variable | is passed to. the 
subroutine to indicate the X,’th data point. In the example, 


y = ax’ + b log (gx): 


X{t,1) = x(i); 

C(1) =a; 

C(2) = b; 

C(3) = g; 

C1(1)-= dy = X(1)t2: 
da 

C1(2) = dy = LGT (C(3)*X(1,1)); 
ob 

C1(3) = dy = C(2)*X(1,1)/(C(3)*X(1,1)) = C(2)/C(3); and 
og 


Y¥1 = Func = C(1)*X(1,1)t2 + C(2)*#LGT(C(3)*X(1,1)). 
Subroutine coding could be entered as follows: 
1090 Y1 = C(1) * X(1,1}t2 + C(2)t* LGT(C(3) * X(1,1)) 
1110 C1(1) = X(i,1)t2 
1120 C1(2) = LGT(C(3)*X(1,1)) 
@ 1130 C1(3) = C(2)/C(3) 
1140 RETURN 
! will always be in the range 


1s Is N11. 


Note that the ith independent variable must be referred to as X(I,1). If more than one 
independent variable exists, refer to them as X(I,1), X(/,2), ..., ...to X(f,N1). 


Data is stored in arrays X(N9,N1) and Y(N9), where N1 = the number of independent variables, 
and N9 = the maximum number of data points, plus one. 


A sample function ts included on the program tape: 


y =a EXP (. sx(@—2))) 


To solve for a, b, and c, we designate parameter c(1) = a, c(2} = b, and c(3) = ©. 





Two constants, defined for convenience as k3 and k2, are coded as follows: 


© _k3 = x(i,1) — c(3), and 


k2 = c(2). 
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aa OPERATING PROCEDURES —_ PROGRAM TWO 











LOAD PROGRAM NUMBER TWO 


KEY #11 





DATA FROM TAPE? 





INSERT 
DATA 
TAPE 


















fF HOW MANY INDEPENDENT VARIABLES? . 
FiLE NUMBER? | 





HOW MANY INDEPENDENT VARIABLES? 











CALCULATE AND DISPLAY THE 


MAXIMUM NUMBER OF DATA 


POINTS ALLOWABLE fe HOW MANY PARAMETERS? Hee 





ENTER X-Y DATA CALCULATE AND DISPLAY THE 
MAXIMUM NUMBER OF DATA 
POINTS ALLOWABLE 





READ DATA FROM TAPE 









INSERT 
PROGRAM 
TAPE 


PROCESS DATA. PRESS USER i 


DEFINABLE KEYS 





oeewere ar ary 
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PROGRAM FOUR 


Zz 


DATA FROM TAPE 


INSERT DATA TAPE RAND ENTER THE TAPE FILE NUMBER = 30 


GAUSS-NEHTON HONLIMEAR LEAST SQUARES FIT 


INITIALIZATION: CREGUIRED BEFORE DATA IS READ "FROM TAPE") 


HOW MANY INDEPENDENT VARIABLES (X1,X2,ETC.> = 1 

HOW MANY PARAMETERS ARE THERE IN YOUR FUNCTION = 3 

WITH YOUR 32K MACHINE YOU CAN HAVE UP TO 1228 DATA POINTS, 
PUT PROGRAM TAPE BACK IN! 





DATA ENTRY 


In the following data entry example, two independent variables (x; and x2) are entered, 
followed by the y value. Values may be separated by a space, comma, alphabetic character, or 
arithmetic operator (t,/, *,+,or—). fa minus sign is used, the number following the sign will 
be negative. The message, nn DATA POINTS ENTERED—THE MAXIMUM POSSIBLE, 
indicates that all available internal storage has been used. 


ENTER Xs¥ = 14.2;8)11.7 
ENTER XsY¥ = 16,21.5,18.2 
ENTER Xs¥ = 16,16.4,11 
ENTER Xs¥ = 18,17.4,11.6 
ENTER Xs¥ * 22.7319531 


#366 ENTER X,Y = 41.5,37.2;19 





Agraphic display of entered data points can be initiated by pressing PLOT DATA (Key #6) after 
initialization has been completed. 
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— When Q7 is negative, 1 is added to Q7 at each iteration until Q7=0. Iteration then continues 
with no further parameter controller change. If one of the first absolute values of Q7 iterations 
shows divergence, Q7 is used as described for a positive Q7 value. 


For example, if Q7 = —3, parameter changes will not be drastic and Q7 will be 0 after 3 
iterations. 


Display of the residual sum of squares and new parameter values at each iteration is optional, 
depending upon the response to the displayed questions. 


Initial parameter values are requested in the following manner: 


#i  15¢@ 
#2 14 
#3 68 


ENTER THE MAX, NUMBER OF ITERATIONS ALLOWED = 258 


j 
ENTER THE INITIAL VALUES FOR THE PARAMETERS: 
RN pf 

1 


- BEGINNING ITERATIONS 
AFTER ITERATION #8, SUM OF SQUARES = 44873.3567019 


BEGIN ITERATION @1 
R 


EL. ERROR IN PARAM. #1 IS STILL LARGER THAN 1.8E-6 
REL. ERROR IN PARAM. #2 IS STILL LARGER THAN 1.@E-6 
REL. ERROR IN PARAM. #3 IS STILL LARGER THAN 1.6&-6 


J NEW PARAN CHANGE IN PARAM 


1 792.835429167 ~7B?. 164578892 
2 14, 8530252645 6. 85302526446 
3 7.53144666155 ~8. 448553338433 
AFTER ITERATION #1, SUM OF SQUARES = 1985781.32278 


BEGIN ITERATION #2 
REL. ERROR It PARAM. #1 IS STILL LARGER THAN !.0E-6 
REL. ERROR IN PARAM. #2 IS STILL LARGER THAN 1.@E-6 
REL. ERROR IN PARAM. #3 IS STILL LARGER THAN 1.8£-6 


J NEW PARAM CHANGE IN PARAM 


| 1284. 90376441 492, 868339382 
2 3.08886 13084 @. 2358360439493 
3 7, 46118641586 ~Q. 8382602456843 
AFTER ITERATION #2, SUM OF SQUARES = 66664. 26353383 


BEGIN ITERATION #3 
REL. ERROR IN PARAM. #1 TLL LARGER THAN 1.6£-6 
REL. ERROR IN PARAM. #2 ILL LARGER THAW 1.0E-6 
REL. ERROR IN PARAM. #3 ILL LARGER THAN 1.9E-6 
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Convergence occurring within maximum iterations is announced as follows: 


~— 


TERMINATION AFTER 9 ITERATIONS. 
FINAL SUM OF SQUARES = $.539159506E-7 
OF = 22 
SIGMA © 1,58675763E-4 


PARAMETER ERROR 


1408. 88032153 8.88196334355898 
15, 0800080261 9. 389847219E-7 
7499399999997 1,.84149567E~-6 


DO YOU WANT TO SEE THE ITHVERSE MATRIX: 





The YES reply initiates calculations, and the lower triangular portion of the G matrix inverse is 
displayed. 


INVERSE MATRIX 
ROW i 
153. 098667198 
ROH 2 
~8. 0489285608647 3, 581229794E-5 
ROW 3 
-8,0583109228323 ~-1,298870972E-6 4. 308179872E-5 


DO YOU WANT THE PARTIAL CORRELATION MATRIX PRINTED: YES 


PARTIAL CORRELATION MATRIX 
ROW 1 
1 
ROW 2 
~@,. 668291382653 { 


ROK 3 
“8. 720450868919 -8.0332372461689 1 
axxD0NERTE 
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PLOT FUNCTION (Key #8) 


GAUSS~NEWTON LEAST SG 





} if the data contains more than one independent variable, an integer must be entered to specify 
which X variable is to be used for the horizontal axis. 


PLOT Y VS X 


Values for other X variables must also be specified. 


WHILE VARYING Xn BETWEEN ITS DATA MIN AND MAX, HOLD X CONSTANT AT: ? 





Enter a value for each independent variable. 


F 
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~  VARIABLES—PROGRAM TWO 


VARIABLE USAGE 

| Data point number passed to user subroutine at line 1100.1 <I< 
(N+1). 

tO Scratch. 

M The number of parameters to solve for. 

M4 1 = Coefficients found. < 
0 = Coefficients not found. 

M5 An array, M4 (M), used to hold the desired accuracy for each 
parameter in SOLVE. 

M6 Scratch in SOLVE. 

N The number of user data points stored in X and Y. 

NO Scratch. 

N1 The number of independent variables. 

N2 Scratch. 

N3 Scratch in SOLVE. 

N4 Scratch in SOLVE. 

N5 Scratch in SOLVE. 

N6 Scratch in SOLVE. 

N7 Scratch. 

N8 An array, N8 (N1+1), used for the input of data points from the 

F keyboard. 

N9 P8+1. 

P An array, P (N1+1, 2), for the minimums and maximums of user data 
points. 

PO An array, PO (8), used for graphing. 

P1 Scratch. 

P2 Scratch. 

P3 Scratch. 

P4 Residual sum of squares in SOLVE. 

P5 Residual sum of squares for the previous iteration. 

P6 ' Scratch. 

P7 Scratch. 

P8 Maximum number of data points that can be stored in the array X, Y. 

P9 Flag used to indicate which user definable key was pressed. 

Q An array, Q (M, M+1), used in SOLVE to hold the system of linear 
equations. 

Q0 . =100. The function is plotted as QO line segments. 

Q1 =N1+1. 

Q2 =M+1. 

Q3 =N+1. 

Q4 In SOLVE, the maximum number of iterations. 

, Q5 In SOLVE, the change to degrees of freedom. 
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Program Three 


-  NELDER AND MEAD FUNCTION MINIMIZATION 


PROGRAM DESCRIPTION 





Function minimization may be needed for reasons ranging from simple to extremely complex. 
A variety of problems can be solved, if they are formulated as function minimization. The 
program can, for example, solve non-linear systems of equations; find roots of equations, fit 
equations to data using difficult criteria, such as the minimum sum of absolute residuals, or 
perform constrained optimization. 


i 
i 
1 


Programs One and Two, previously described, are executed with greater efficiency when input 
parameters are assigned realistic starting values. The Function Minimization Program 
provides valid initial parameter values for either program. Best starting values occur for initial 
estimates which result in a minimum sum of squares. 


The program uses the Nelder-Mead simplex procedure to find the minimum of a known 
function. The function must be continuous, and a jocal minimum must exist. 


A user-written subroutine specifies the function to be minimized. 


METHODS 


A direct search method is used and no derivative evaluation is required. 


A simplex (in n dimensional space) consists of at least n+1 points enclosing a non-zero 
volume. Function evaluation occurs at the simplex vertices defined in the variable space, and 
movement is away from the worst value. 


For example, suppose that F, a function of two variables, is to be minimized, and a simplex 
consisting of points A, B, and C is generated. Let F(A) be function value at A, and let F(A) > F(B) | 
> F(C). . 


The function is evaluated at E, the reflection of A through D; the centroid of B and C. Anew 
simplex is then generated, as shown in Fig. 1, and Table 3-1. 
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NELDER-MEAD FLACTION MINIMIZATION 


ENTER THE FUNCTION TO BE MINIMIZEO STARTING IN LINE HUMBER 1666. ALL 
LINES OF CODE DEFINING THE FUNCTION TO BE MIHIMIZEG MUST FOLLOW 
CONSECUTIVELY. THE FUNCTION DEFINED MUST SATISY: 

1. THE SUBROUTINE MUST RETURN THE SIMPLE VARTABLE ¥ TO 
THE MAIN PROGRAM. 
2, THE VARIABLES OVER WHICH THE FUNCTION IS MINIMIZED 


ARE THE VARIABLES IN THE ONE DIMENSION ARRAY %; 
THAT IS X€C105XC2)>,.459XCK), 

3. THE SUBROUTINE DEFINING THE FUNCTION MUST END WITH 
A RETURN STATEMENT AS THE FINAL STATEMENT. 


AFTER THE FUNCTION IS KEYED IN PRESS THE USER DEF INABLE 
INIT {KEY #1} TO ENTER STARTING VALUES AND STEP SIZE. 





A function is coded into the original program to serve as an example. The function, Y = 
100 * (X, ~ X;) 12 + (1—X1) t2, has a zero minimum at point X; = 1, X2 = 1. 





TEST FOR CONVERGENCE ie 


The convergence test is based upon function value variance at the simplex points. When 
variance is less than a pre-assigned value, convergence ts declared. If Y;, ..., Yn are function 
values at simplex point n+1, convergence is declared when: 
x (Y; — ¥)? < E, where Y = LYi/(n+1). 
n 


When convergence has been obtained, increased accuracy can be achieved as follows: Press 
INITIALIZE ; enter the previous resultant best answer as a starting value; and set E to a lesser 
value than before. 


PROGRAM EXECUTION 


When program three has been loaded, and the subroutine has been entered at tine 1000, User- 
Definable key #1 will permit starting values and step size to be entered. INITIALIZE (key #1) is 
the only operable key during execution of this program. 


SIMPLE FUNCTION MINIMIZATION EXAMPLE 


This minimization example uses the program to find the minimum of a parabola described by Y 
= 11+3(x +4)’. Minimum Y value = 11 fora value of X = —4. Any other X value would lead toa 
larger value of Y. 
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INITIAL PARAMETER OPTIMIZATION EXAMPLE > 
sass = 
Parameter optimization for Nonlinear Least Squares Programs One and Two can be O | 
accomplished as follows: iF 
t 
Initial parameters for Nonlinear Least Squares Programs One and Two should be optimized | 
with respect to function and data set. The technique used reads in all data pairs, as in the least 
squares program, computes the sum of the squares of the function, and minimizes this sum. 
The subroutine listing shown here will optimize initial parameters for function Y2. 
REM 
® FIND 9 
$28 READ @33:N9 
$30 DIM X1(N9),Y1CN9D 
$48 FOR I=i TO N9 ¥ 
35@ READ @33:xX1(1>, ACID r=) 
6@ NEXT I 5 
P+] 
> 
1816 FOR I=1 TO W9 = 
1828 Y2=X(1)SEXPC-X(2)8K8 CLD 4X C3SERP (-XC4 SKI CTD a 
183@ Yave(vi(I>-72>42 < 
184@ NEXT I m 
1858 RETURN 
Lines 500-900 cause the X,Y data pairs to be read into the subroutine. The data is stored in file 3 
in this example. Line 520 reads the number of data pairs as N9. Lines 530 to 560 read arrays 
X1(N9) and Y1(NQ). This is the standard format for data storage in Programs One and Two. 
f 
Lines 1000-1050 are executed for every program iteration. Lines 1010 and 1040 loop through 
the user function for each of the data points. 
Line 1020 contains the user functions. The function here is: = 
Y = a EXP(—bX) + c EXP(—dx) 2 
z= 
w 
where e 
Y2=Y; 
X1(1) = X; 
X(1) = a; 
X(2) = b; 
X(3) = c; and ; 
X(4) = d. 
The “Initial Parameters” that would be entered in Program One are entered for X(1) through ss 
X(4). The program will return better values as output. F 
Line 1030 computes the sum of squares and serves as the function to be minimized. = 
fi 
< 
_ om 
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~ PROGRAM FILE ALLOCATION 


Program Three is contained in file 15. 


Rawk kU er ee me 
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VARIABLES—PROGRAM THREE 


VARIABLE 


AQ 
BO 


Bg 
CO 
c9 
Et 
E$ 

F1 
H8 
H9 
i, J1 
L8 
L9 

N 

N1 
SO 
S1 
S2 

x 

Y 
Z0, 24 
25 
Z8 
zo 
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USAGE 


Reflection coefficient, set equal to 1. 

An array, dimensioned N + 1 by N + 1, containing the current 
coordinates of the simplex N + 1 points. 

Contraction coefficient, set equal to .5. 

A scratch array, dimensioned N rows by 3 columns. 
Expansion coefficient, set equal to 2. 

Convergence criteria. 

Scratch string array. 

Scratch variable. 


Largest value of the function evaluated at the simplex N + 1 points. 


An index, locating the column of BO with largest function value. 
Scratch variables. 


Smallest value of the function evaluated at the simplex N + 1 points. 
An index locating the column of BO with the smallest function value. 


Number of variables. 

N+ 1. 

Vector of starting values. 

Vector of step sizes. 

Mean of function values evaluated at N + 1 points of simplex. 
Array containing the variables. 

Function values. 

Scratch variables. 

Approximate frequency with which to print function values. 
Approximate frequency with which to check for convergence. 
Number of function evaluations. 
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Program Four 


7 NONLINEAR SYSTEMS OF EQUATIONS 


PROGRAM DESCRIPTION 


Program Four consists of three program segments: 


1. a subroutine to solve the system of nonlinear equations; 

2. a main program to use the subroutines; and 

3. Another subroutine, a sample, to specify a system of nonlinear equations. A user-written 
subroutine defining the system of equations replaces the sample subroutine. 


For clarity in this manual, subroutine #1 above will be referred to as NLSE (non-linear system of 
equations subroutine). 


2: MAIN PROGRAM 


METHODS 


Powell's algorithm, used in NLSE, converges rapidly with nearly global convergence. The 
algorithm combines features of the Newton-Raphson, the Levenberg-Marquarat, and the 
steepest descent methods. 






NLSE requires N equations of the form f,{xi, X2, ..., xx) = 0. 


N represents the number of variables, and therefore the number of equations. j=1,2,...,N;and 
N > 1. 


In vector form, X = (xi, ..., Xn) , and F(X) = (f:(X),f2(X), ..., fw (X)). If N = 1, and x. = value of x at 
kth iteration, Newton’s method would be: 


Keer = Xx — f(Xe) = Xe — (F(X) * £(X). 
f'{Xx) 


If N 2, Xue = Xe — SK) & FOX). 


J(X:) is the Jacobian matrix of F, evaluated to X.. i 
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The user-written subroutine, Starting at line number 1100, m 
and must end with a RETURN statement. For example, if 
EXP(—x1) + EXP(—x2) — 1.0001, the subroutine could be en 


1100 
1110 
1120 
1200 


ust define the system of equations 
1 = 10,000 * x, * xX. — 1, and f; = 
tered as follows: 


REM YOUR ROUTINE: 

F(1) = 1E4*X(1)*X(2)—1.0 

F(2) = EXP(—X(1))+EXP(—X(2))—-1.0001 
RETURN 


DELETE 1130, 1190 
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= When the subroutine has been entered, type RUN and begin the assignment of variable values. 
The procedure is demonstrated by the display shown here. 


NONLINEAR SYSTEMS OF EQUATIONS 


ENTER Ny THE NUMBER OF EQUATIONS = 2 
ENTER THE VECTOR X, THE INITIAL VALUE FOR ITERATIONS: 


Mi = 2.2 
x2 = 2.86 


ENTER E, THE ACCURACY REQUIRED IN THE SOLUTION (EG, 1E-10> = 1E-6 


ENTER D@, THE “DELTA” FOR THE DERIVATIVES CEG, 1£-3> = 1€-3 
ENTER THE MAX. # OF ITERATIONS TO BE ALLOWED = 48 
ENTER Diy AN UPPER BOUND ON THE DISTANCE TO A SOLUTION (EG, 188) 


DG YOU WANT X & F PRINTED AT EACH ITERATION STEP: YES 





us The iast entry shown assigns the value to variable N1. 


AFTER 2@ EVALUATIONS OF F: t 
J XCD FCS) 
i @.501764141336 -8.00103898478168 : 
2 3. 14343315927 8.448831 758E~-4 , 


FINAL SOLUTION, AFTER 21 EVALUATIONS OF F IS: 
J XCS> FCJ 


(J) 
1 8. 499876133931 6.B27592991E-5 
2 3.1415123675 -1.580331983E-5 





User-Definable keys are not operable during execution of this program. 


PROGRAM FILE ALLOCATION 


Coding for this program is stored in file 17. 
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Program Five 


EXPONENTIAL LEAST SQUARES — 


PROGRAM DESCRIPTION 


The Exponential Least Squares program performs a least squares fit to data pairs of the form 
X1Yj,....%n¥n. The model used, y=Ao+tAi*e |” +...+A,*#e "| permits a choice of the 

number (J) of exponential terms. However, when more than three exponential terms are used, 
a result will not always be found. 


Any parameter may be held constant at a selected value, thus effectively altering the model. For 
example, the model can be modified to:y=A:* °'** +...+A,*e ”** by assigning azero 
value to Ao (Ao = 0). 


METHODS 


Optimal parameter values are determined by the Gauss-Newton iteration method from a user 
specified starting point. Convergence, if at ail, will be to a jocal least squares minimum. A 
global best solution is not a certainty. 


Parameters are stored in array X0 as follows: 


X0(1) = Ao a 
X0(2) = Ai X0(3) = Bi 

X0(4) = Az X0(5) = B2 

XO(M—1) = Aj XO(M) = 8, when J = the number of exponential 


terms, and M = 2% J+1. 
Parameter computations minimize the residual sum of squares equal to 


N 
= (¥, — Func {x;, X0))’. 
i=1 


Func (xi, XO) = X0(1) + X0(2)* EXP(X0(3)*x;) + ... XO(M—1)* EXP(X0(M)*x;). N = the number 
of user data points; x; = i'th observation of the independent variable; and y, = pth observation of 
the dependent variable. 


At each iteration, an M by M system of equations is formed and solved. The solution yields a 
change in XO to produce a smaller residual sum of squares. Iteration continues until the change 
in each parameter is less than the user specified quantity. 
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The linear systems are symmetric, and only the upper triangular portion is formed. The system 
is solved by the Cholesky decomposition method. 


PROGRAM EXECUTION 


When Program Five has been ioaded, a displayed message will offer a choice of data input 
methods. Press INIT (key #1) to enter data from the keyboard. Press FROM TAPE (key #11) to 
read data from a magnetic tape data file. 


Initialization then occurs as shown on the program operating procedures flow chart. 


OPERATING PROCEDURES PROGRAM FIVE 












LOAD PROGRAM NUMBER FIVE 


DATA FROM TAPE? 


INSERT 
DATA 
TAPE 








ENTER X-Y DATA 
FILE NUMBER? 


] READ DATA FROM TAPE 


INSERT 
PROGRAM 
TAPE 




















PROCESS DATA. PRESS USER 
DEFINABLE KEYS 
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Wier 


INITIALIZE (Key #1) 


When INITIALIZE is pressed, the program calculates and displays the maximum acceptable 
number of data points. If points are evenly spaced, X minimum and step size must be entered. If 
they are not evenly spaced, points are entered immediately. A comma, space, alphabetic 
character, or arithmetic operator (t, /,*, —, or +) can be used to separate X and Y vatues. Ifa 
minus sign is used, the number following the sign will be negative. 


EXPONENTIAL LEAST SQUARES 


WITH YOUR 32k MACHINE YOU CAN HAVE UP TO 1178 DATA POINTS. 


ARE THE XI’°S EVENLY SPACED: NO 


1 ENTER X,Y = 18+77 





FROM TAPE (Key #11) 


The FROM TAPE key permits data to be read directly into memory from an existing magnetic 
} tape file. When the data is in memory, deletions, corrections, or additions can be accomplished 
by using appropriate keys. . 


DATA FROM TAPE 
IHSERT DATA TAPE AND ENTER TAPE FILE NUMBER 


EXPONENTIAL LEAST SQUARES 
WITH YOUR 32K MACHINE YOU CAN HAVE UP TO 1168 DATA POINTS, 


PUT PROGRAM TAPE BACK IN. 





PLOT DATA (Key #6) ( 


EXPONENTIAL LEAST SQUARES 


% MIN = 8 Y MIN = 9863.935819841 
xX MAX = 5 Y MAX = 3988 


PRESS "RETURN" FOR THE GRAPH, 


a ees 


RGAE ASU bases 
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EXP LEAST SQUARES 





SOLVE (Key #7) 


The SOLVE routine is invoked whenever the SOLVE key (#7) is pressed. Itis also calied by the 
PLOT FUNCTION, ESTIMATES, and PRINT PARAMETERS keys if the routine has not been 
executed since the last data entry. 
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Mis SOLVE ROUTINE . PROGRAM FIVE 









ENTER NUMBER OF EXPONENTIAL TERMS 





ALL PARAMETERS FOUND TO 
DEFAULT ACCURACY ? 










YES 


ENTER REQUIRED ACCURACY 












ENTER PARAMETER CONTROLLER FOR 
CASE OF DIVERGENCE 






PRINT RESIDUAL 
SUM OF SQUARES AT 
EACH ITERATION ? 







PRINT NEW 
PARAMETER VALUES AT 
EACH ITERATION ? 










PROCESS AND DISPLAY 





When the SOLVE key is pressed, tape file #21 is appended at line 1000, and the following 
display appears. 


EXPONENTIAL LEAST SQUARES 


HOW PANY EXPONENTIAL TERMS DO YOU WANT IN YOUR MODEL = 3 


DO YOU WANT ALL PARAMETERS FOUND TO THE DEFAULT ACCURACY (1E-6): YES 


CHOOSE THE PARAMETER CONTROLLER FUR THE 
CASE OF DIVERGENCE ¢(@ IS NO CONTROL? = @ 
DO YOU WANT THE RESIDUAL SUM GF SQUARES PRINTED AT EACH ITERATION: YES 


BO YOU ALSO WANT THE NEW VALUE OF THE 
PARAMETERS PPINTED AT EACH ITERATION; YES 
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A parameter is held constant by entering a negative accuracy value. 


Parameter controllers are discussed in section three (Program Two, SOLVE Routine). 


ENTER THE INITIAL VALUES FOR THE PARAMETERS: 
AGB = 488 


Al 1488 
B1 -1 


A2 = 675 


B2 -.08 


Az 1158 
B3 -.5 


ENTER THE MAX. NUMBER OF ITERATIONS ALLOWED = 188 





iterations then begin and information is displayed according to your SOLVE specifications. 











BEGINNING ITERATIONS 
AFTER ITERATION #8, SUN OF SQUARES = 974302, 108572 






BEGIN ITERATION @1 
REL. ERROR 1 



















N PARAM. 48 1S STILL LARCER THAN 1.@E-6 

REL. ERROR IN PARAM. Al 1S STILL LARGER THAN 1.@E-6 
REL. ERROR IN PARAM. Bi 1$ STILL LARGER THAN 1.@E-6 
REL. ERROR IN PARAM. AZ 1S STILL LARGER THAN 1.0E-6 
REL. ERROR IN PARAM. Bz 1S STILL LARGER THAM 1.@E-6 
REL. ERROR IN PARAM. AZ 1S STILL LARGER THAN 1.@E~-6 
REL. ERROR IN PARAM. BI 1S STILL LARGER THAN 1,.BE-6 

HEH PARAM CHANGE IN PARAM 
Ae 616, 86965822 216.96965822 
Al 292.91452967 -1187.@8547033 
B1 -@, 975264499590 6. 024735518482? 
A2 €24. 639959287 -50. 3668407928 
B2 -8, 15600478668 -0,0760047866801 
AZ 2265.97599711 4115.57559711 
B3 -8,64577518241 -6,14577518241 


AFTER ITERATION #1. SUM OF SQUARES = 86331.1632299 












BEGIN ITERATION 82 
REL. ERROR IN PARAN. AO IS STILL LARGER THAN 1. 

REL. ERROR IN PARAM. Al 1S STILL LARGER THAN 1. 
REL. EXROR IN PARAM. Bl 1S STILL LARGER THAN 1. 
REL. ERROR IN PARAK. AZ 15 STILL LARGER THAN I. 
REL. ERROR IN PARAM. B2 1S STILL LARGER THAN 1. 
LARGER THAN 1. 
















REL. ERROR IN PARAM. AZ 1S STILL 
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Ss - If there is no inverse for the matrix, new parameter starting values must be entered. 


THE MATRIX HAS BECOME SINGULAR. 
TRY AGAIN WITH DIFFERENT STARTING VALUES, 


ENTER THE INITIAL VALUES FOR THE PARAMETERS: 


Ag = 


Al 
Bt 


a2 
B2 





If convergence is not achieved within the specified maximum number of iterations, available 
options are displayed. 


SUN OF SQUARES = 821.460426471 
NO CONVERGENCE AFTER 108 ITERATIONS. 
YOU HAVE FOUR OPTIONS AT THIS POINT: 
1, USE THE CURRENT PARAMETER VALUES. 
2. TRY FIVE MORE ITERATIONS. 
: 3. ENTER WEW INITIAL VALUES FOR THE PARAMETERS. 
4. START THE GAUSS-NEWTON SOLUTION OVER FROM THE BEGINNING. 


: ENTER YOUR CHOICE (1,2,3, OR 4) = 





When convergence is achieved, displays are as follows: 


TERMINATION AFTER 6 ITERATIONS, 
FINAL SUM OF SQUARES © 5,954050209E-9 
DF = 18 
SIGMA = 1.618737384E-5 


PARAMETER ERROR { 
Ag 408. 89816539 8.487979647431 


Al 4199.99916543 3. 16469168e78 
B1 “8. 700008853256 2. 886243681E-4 


A2 76Q, BOGH336R5 8. 6966567148027 
B2 -@. 186880062997 1.5885342845-4 


a3 1580. 66863558 2.67189339476 
B3 -8.500068124u55 3,492507145E-4 


DO YOU WANT TO SEE THE INVERSE HMATRI¥: 
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aEKDONE RSS 


ROW t 
5.83195802E+6 


OW 2 
-3, B69886698E+9 


ROW 3 
-254486. 038244 


ROK 4 
1.071014613E+8 


ROK 5 
- 195981, 892363 
76, 2874673353 


ROW 6 : 
3, 258794464E+9 


-1272616. 43286 


ROW 7? 
-417246. 93126 
162.801682532 


INVERSE MATRIX 


3.027 769594E +18 


1995718. 67766 


-8,562209407E+8 


1518459, 06732 


-2.555243426E+18 
2.156940471E+19 


3254245. 6538 
~2745336. 2313 


131.580060221 


-$6573.4694968 


99, 3829208169 


-1€84662. 2888 


214.41165737 
349,991989319 


2. 484619943E47 


-41963. 5588528 


7. 242747318E+B 


~91667,. 2883734 


DO YOU WANT THE PARTIAL CORRELATION MATRIX PRINTED: YES 





ROW 1 
1 


ROW 2 
8. 991239374961 


aw 3 
-B. 989009368765 


ROK 4 
@.957B4886651 


ROH 5 
-@. 999763815287 
1 


ROW 6 
8. 989166467732 


-8.992091774041 


ROW ? 
-8, 994249988158 


@, 996329581471 






NE 84 AN A 


PARTIAL CORRELATION MATRIX 


i 


8.999866461469 


~8, 9871756853594 


@.9938502486E5 


Fis iceman 


8.99967 739817 
=0. 999188460758 


i 


-0.989476186816 


@.991958758549 


-8. 9999978887 


ales lata 





i 


-8, 963863935824 


6. 969359624998 


-8. 983604144913 
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PLOT FUNCTION (Key #8) 


EXP LERST SQUARES 





PROGRAM FILE ALLOCATION 


The Exponential Least Squares program is stored on tape files 18 through 22. When a User 
Definable key is pressed, the appropriate file is read into memory without any further operator 


action. 
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VARIABLES—PROGRAM FIVE 


VARIABLE 


1, 10 
M 
M4 


N 


N1, N2, N3, N4, N5, 


N6, N7 

P 

P(1) 

P(3), (4), (5), (6), 
(7), (8), (9), (10) 
P(11) 


P(14) 


P(23), (24), (25), (26) 


PO 

P1, P2, P3, P4, PS, 
P6, P7 

P9 

P$ 

Q 

QO 


Q7 
Q3g 
Q$ 
X,Y 
XO 
X4 


Y1 

WO 
W1 
We 
W3 
W4 
W5 


USAGE 


Scratch 


The number of parameters to solve for. 


1 = Coefficients found. 


0 = Coefficients not found. 
The number of user data points. 


Scratch. 


A scratch linear array, P(26). 


A number indicating data pair capacity of X,Y arrays. 


Used for plotting window and labeled axes. 


1 = Evenly spaced data entry. 


2 = Randomly spaced data entry. 
Step size for evenly spaced data. 


(x maximum—x minimum) divided by QO. 


Scratch. 


Flag to indicate key pressed. 
A string, P$(1), for input of YES/NO responses. 
Q(M,M+1), used to hold the normal equations. 


X minimum, maximum, y minimum, maximum for user data. 


= 100. A plotted function is drawn as QO line segments. 
Q1, Q2, Q3, Q4, Q5, Q6 Scratch. 
An integer, entered by user, used as a parameter controller. 

The device address for graphics display. Initialized value = 32. 


Scratch. 


Linear array, X(P(1)), Y(P(1)), holding N x,y data pairs. 
An array, XO0(M), the values of the parameters are stored here. 
An array, X1(M), the partial derivatives of the user model with 


respect to the parameters. 


Scratch. 

Constant 0.0. 
Constant 1.0. 
Constant 2.0. 
Constant 3.0. 
Constant 4.0. 
Constant 5.0. 


ane een ee One Et ne ce TS 
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Program Six 


EXPONENTIAL ONE—KNOT SPLINE 


PROGRAM DESCRIPTION 


This program performs a least squares fit to data Pairs xi, yi. The modelis y=eF where F{x)is 


a one-knot cubic spline. The program is especially effective for data rising to a single peak 
before decaying. 


The mode! was suggested by Svante Wold for use in pharmacokinetics, and as a replacement 
for the classical compartment model of T. Teorell. 


‘ 


METHODS 


At least five data pairs are required and the y, must always be greater than zero. 


The one-knot cubic spline, F(x), is found by transformation. When “a” is the location of the 
knot on the x-axis, and t = x—a: 


In y = F(x); 
In y = bo + bit + bot? + bst’ if t = 0: and 
In y = bo + bit + bot? + ast? if t< 0. 


A fifth order symmetric system of linear equations is solved by the Cholesky decomposition 
method. The solution, coefficients bo, bi, bo, bs, and as, is stored in array c. 


F(x) = c(1) + c(2)*t + c(3)* tt2 + c(4) * tt3 fort > 0. 
F(x) = c(1) + c(2)*t + c(3)*tt2 + c{5) * t!3 fort <0. 


PROGRAM EXECUTION 


To load this program, press AUTOLOAD andenter6. File 24 willbe OLDed, and execution will 
proceed in accordance with the operating procedures flowchart. 
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SR ne oe at nite: 
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_ . INITIALIZE (Key #1) 


The machine data point Capacity will be displayed when INIT is pressed, and you must indicate 
whether or not x values are evenly spaced. If step size is uniform, the first x value and step size 
are entered. Subsequent data point entries will require the y value only. 


LH91a WYYSOud 


If x values are not evenly spaced, data entry will require both x and y values for each point. 


7. XN 


EXPONENTIAL ONE KNOT SPLINE REGRESSION 


s +a ee ane ttt bintateeinn eee 
a Sl teiePe F 


WITH YOUR 32K MACHINE YOU CAN HAVE UP TO 1416 DATA POINTS. 
ARE THE XI‘°S EVENLY SPACED: NO 


aNIN WYHDOUd 


ENTER X,¥ = 0,6.43 
ENTER X,Y = 13,9.47 
ENTER X,Y = 26,15 : 
ENTER Xs¥ = 39,25.7 
ENTER X)¥ = 52,45 
ENTER X,Y = 65,68 ¢ 
ENTER XY = 78,45 a 
ENTER Xs = 91,25,? 
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FROM TAPE (Key #11) m 


When this key is pressed, a data tape must be inserted and the file number entered. When the 
file has been read into memory, data point capacity will be displayed. 
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PLOT DATA (Key #6) 


EXP 1 KNOT SPLINE 


t 


SOLVE (Key #7) 


The SOLVE routine, executed by pressing key #7, causes tape file #26 to be appended at line 
1000. The knot location can be specified, or the default value can be used. 


6-4 
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Y IS MAXIMUM CHITH A VALUE OF 68) AT X = 65 
DO YOU WAHT TO USE xX = 63 FOR THE KNOT: NO 
ENTER THE X VALUE FOR THE KNOT = 52 
(BETHEEN @ AND 117) 
R~SQUARE = 8.973319988341 
STAN DEV = 3.6062308962 
PRESS "SOLVE" <KEY €7) WHEN YOU WANT A NEW FIT. 
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Coefficients are calculated and the accuracy of the fit is displayed. 


—_— 


Y IS MAXIMUM CWITH A VALUE OF 68> AT X = 65 
DO YOU WANT TO USE X = 63 FOR THE KNOT: YES 


R-SQUARE = @.992268884027 
STAN DEV = 1.61659142832 
PRESS "SOLVE" {KEY #7) WHEN YOU WANT A NEW FIT. 





R-SQUARE and STAN DEV indicate the goodness of fit as follows: 


R-SQUARE = 1: a perfect fit has been obtained. 
R-SQUARE = 0: data is sufficiently random to preclude fitting. 
No fit has been obtained. 


x (residuals)? 
Xy* — (zy)? 
N 


R-SQUARE = 1- 





STANDARD DEVIATION =/N 
x (Residuals)?/(N—1) 
j=1 


SOLVE ROUTINE PROGRAM SIX 







DEFAULT KNOT VALUE? 


ENTER KNOT VALUE 





CALCULATE AND DISPLAY GOODNESS 
OF FIT AND STANDARD DEVIATION. 
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PLOT FUNCTION (Key #8) 


EXPONENTIAL ONE KNOT SPLINE REGRESSION 


X MIN = 6 Y MIN & 6.43 
X WAX = 104 ¥ MAX = 68 


PRESS "RETURN" FOR THE GRAPH. 


EXP 1 KNOT SPLINE 


z 





The knot used for calculation is denoted by the K under the X axis. 


PROGRAM FILE ALLOCATION 


This program is coded in files 23 through 27, inclusive. The proper file is read into memory 
automatically when any functional User-Definable key is pressed. 
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~ VARIABLES—PROGRAM SIX 


VARIABLE USAGE 
C The array, C(5), containing the parameters of the fit (see 
METHODS). 
M4 Flag 1 = Coefficients found. 
0 = Coefficients not found. 
JN The number of user data points. 
P A scratch linear array, P(26). 
P(1) The maximum number of data pairs that can be stored in the X, Y 
arrays. 
P(3), (4), (5), (6), 
(7), (8), (9), (10) Used for plotting window and labeled axes. 
P(11) 1 = Evenly spaced data entry. 
2 = Randomly spaced data entry. 
P(14) Step size for evenly spaced data. 
P(16} Default value for knot. 
P(17) y value associated with P(16). 
P(18) x value chosen for the knot. 
P(23), (24), (25), (26) x minimum/maximum, y minimum/maximum for user data. 
PO (x maximum—x minimum)/QO. 
P1, P2, P3, P4, 
= PS. P6P7 Scratch. 
P9 Flag to indicate key pressed. 
P$ A string, P$(1), for input of YES/NO responses. 
Q Q(5,6}, used to hold the normal equations. 
QO = 100. The function plot is drawn as QO line segments. 
Q1, Q2, Q3, Q4, 
Q5, Q6, Q7, Q8 Scratch. 
Q9g The device address for graphics display. Initialized value = 32. 
Q$ Scratch. 
X,Y Linear array, X(P(1)), Y(P(1)) holding N x,y data pairs. 
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Program Seven 


= CUBIC SPLINE FIT 
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PROGRAM DESCRIPTION 


A cubic spline is a piecewise cubic polynomial. Junctions formed where cubic polynomial 
pieces fit together on the X-axis are knots. ) 


This program applies either of two cubic spline fitting techniques to x,, y, data pairs. The cubic 
spline interpolation method requires a knot at each x data point and achieves a perfect fit. A 
smooth curve is drawn through the data points. 






The least squares regression method enables the user to control the number and location of 
the knots. 
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NOTE 


The 4051R01 MATRIX ROM PACK is required for the feast Squares regression 
method. 


METHODS 


Cubic polynomials are constructed to permit the spline, F(x); the derivative, F’(x); and the 
second derivative, F’’(x), to be continuous at each knot, kj. 
When M = number of knots; j = 1,...,M—1; t = x—k; and ks<x<kj1; then: 
F(x) = c(j,1) + c(j,2) *t + c(j,3) *t? + ¢(j,4) #t? 
= ((c{j,4)et + C(j,3))#t + c(j,2))et + c(i,1). 


INTERPOLATION 


The interpolation method requires at least three data points, and each point must be distinct. 
The program places a knot at each x, value, and F(x) interpolates user data values xi, yi. (i= 
1,...,N, and F(x;) = yi.) 





++ tinder sya 


on rere 


F’"(x:) is determined by solving a tridiagonal system of N linear equations. The equations are 
symmetric and strictly diagonally dominant. Pivoting is not required. 


ee a ee 


NOILVWHOJNI SONVHO 


With (xi) and F’'(x:) known, cubic spline coefficients are determined. 
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REGRESSION 2, 


The regression method, with M = number of knots, solves a 2M by 2M system of linear 
equations. The equations are solved by the 4051R01 MATRIX ROM Pack INV Function. 


The user determines the closeness of fit by establishing the number and location of knots. 
More knots produce a cioser fit, but require a longer fitting time. 


Ordinarily, five or more data points should fall between knots. A relative maximum or minimum 
should be centered between knots, with no more than one maximum or minimum, and one 
point of infiexion between each knot pair. If possible, choose knots close to inflexion points. 


Large amounts of machine memory, required by the matrix, impose a program limitation. 
Maximum knot capacity varies between 15 and 27 knots, depending upon machine size. 


PROGRAM EXECUTION 


When Program Seven is selected from the menu, INITIALIZE (Key #1) or FROM TAPE (Key 
#11) must be pressed. INITIALIZE will cause the display shown here. 


CUBIC SPLINE FIT me 
INITIALIZATION: | 
THE NUMBER OF DATA POINTS YOU CAN HAVE WITH YOUR 32K MACHINE 
DEPENDS UPON THO FACTORS: 
1, WHICH METHOD YOU CHOOSE: 
A. SPLINE INTERPOLATION CONE KNOT PER DATA POINT) 
B. SPLINE REGRESSION (REQUIRES A LARGE SCRATCH ARRAY? 
2. THE NUMBER OF KNOTS DESIRED (FOR METHOD B. ONLY>. 


METHOO NO. DATA POINTS NO. KNOTS 
SPLINE INTERP, 
SPLINE REGRES. 


MOTE: WITH FEWER KNOTS YOU CAN HAVE MORE DATA POINTS. 
(FOR METHOD B. ONLY) 


ENTER AN UPPER BOUND ON THE NUMBER OF DATA POINTS = 408 





FROM TAPE will require a data tape insertion and data file number entry. Data from the tape file 
will replace all data previously in memory. When the data has been read into memory and the j 
program tape has been re-inserted, the initialization display will appear. ¢ 


— 
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After initialization, standard deviations can be entered for each data pair, or the default value 
(1) may be elected. Weight assigned to data points is inversely proportional to the standard 
deviation value. The larger the standard deviations, the less weight given. 
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lfx values are evenly spaced, the initial x value and Step size incremental value can be entered, 
Subsequent entries will require the y value only. 


DO YOU WANT TO ENTER STANDARD CEVIATIONS FOF THE V2 LONG WITH 
THE (X1s¥1> DATA? (A NO RESPONSE WILL CAUSE ALL DEVIATIONS To 
DEFAULT TO 1. YOU MAY THEN CHANGE INDIVIDUAL VALUES BY USING 
"CORRECT" <KEY #1435 : NG 





ARE THE XI’S EVENLY SPACED: YES 





ENTER X MIN AND STEP SIZE = 3,25%.725 . 2 
1 X= 3.25 ENTER Y = 4,3 © 
2 X = 3.975 ENTER Y = 4.85 z 
7 £ 
a 
m 
Unevenly spaced x values will necessitate entry of each x and y value. 
PRINT DATA (Key #5) 
When this key is pressed, X(1), Y(I), and Standard Deviation are displayed in three column ae 
format. - 


ad 







Y! 
3.629645729E-4 
?. °28384792E~-4 
8.881645a6887564 
@.36 8.88349967291594 1 









a 6.48 @.90743578987706 1 é 
6 8.6 @.815757a38832 1 
? 8.72 @. 8332044562131 1 






@. 6691632835212 
@. 146715957938 
0. 273639810864 
@.4917351223362 
6. 785876475893 
2.1 
1.33816429751 
1.49579625873 
1.56341301506 
1.62619486454 
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PLOT DATA (Key #6) 


CUBIC SPLINE FIT 
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a OPERATING PROCEDURES PROGRAM SEVEN 












LOAD PROGRAM SEVEN 


DATA FROM TAPE ? 





ENTER UPPER BOUND ON NUMBER 
OF DATA POINTS 


NO 
ENTER STANDARD DEVIATION ? 


STANDARD DEVIATION = 1 
ENTER FIRST X AND STEP SIZE 


XI’s EVENLY SPACED ? 


ENTER X AND Y VALUES ENTER Y VALUES 






PROCESS DATA. PRESS USER 
DEFINABLE KEYS 
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OPERATING PROCEDURES PROGRAM SEVEN : 






D.F.T. KEY #11 





INSERT 
DATA 
TAPE 







ENTER FILE NUMBER 









ENTER UPPER BOUND ON NUMBER 
OF DATA POINTS 





NO YES 


STANDARD DEVIATIONS ON TAPE? 















READ X AND Y VALUES. 
STANDARD DEVIATION = 1 


READ X, Y, AND STANDARD 
DEVIATION VALUES 






INSERT 
PROGRAM 
TAPE 











PROCESS DATA. PRESS USER 
DEFINABLE KEYS 
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L OPERATING PROCEDURES PROGRAM SEVEN 





YES 
X's EVENLY SPACED ? 










ENTER X, ¥, AND STANDARD 
DEVIATION VALUES 





ENTER FIRST X AND STEP SIZE 








ENTER Y AND STANDARD 
DEVIATION VALUES 














PROCESS DATA. PRESS USER 
DEFINABLE KEYS 
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CHANGE INFORMATION canes 
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_ LOT FUNCTION (Key #8) 


Data points listed in the PRINT DATA exampie will be plotted as shown here when the PLOT 
FUNCTION key is pressed. 
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Interpolation places a knot at each data value and denotes these locations by placing a "K” 
below the x-axis. 
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” SKK KKKKKKKKKKKKKKKKKKKKKK 
8.80 1.09 2.88 3.88 
Data point #13 in this example could be deleted by pressing DELETE ANY (Key #13) and 
entering the point number. 
DELETE DATA PUINTS 
ENTER POINT NUMBER = 13 
ENTER POINT NUMBER = 
a 
ae) 
=x §. 
‘> BR: 
ia a 
> 
wm 4 
iz ie 
nh . 
© BE. 
a g: 
is BF 
> Fe 
ra Be 
iD 
7-9 3a 





_OT 50: STATISTICS VOLUME 4 @ 





¥ AWNIOA SOILSILVLS (0S 107 


oe. a, 


OH OO oe ot 6 5 oe 


erie 


eae a 6 4 94 PEF 


NOISS34993y y3ryno4 





GS-8 


seh +b watt cages! |G. 


NOLLVAHOANI 2DNVHD 





The Regression method provides options shown in the following display. 


4 
3 
¢ 
4 
3 
bd 
| 
a 
¢ 
| 


CUBIC SPLENE REGRESSIOn ON 3 DATH FOINTS. 
YOU CURRENTLY HAVE 3 KNOTS. 


YOUR OPTIONS AT THIS POINT ARE: 


1. ENTER AN ENTIRELY NEW KNOT SET. 
2. ADD KNOT(S> TO THE SET. 
. DELETE KNOTCS) FROM THE SET. 


« CORRECT KNOT VALUECS), 
S. PRINT THE CURRENT KNOT VALUES, 
- PERFORM THE REGRESSION WITH 
THE CURRENT KNOT SET. 





ENTER YOUR CHOICE (1,2,...-+36) * 





28 te rrp git = 


Alia) MWR AL 


Option 1 allows the x-value of each knot location to be entered. 


alas 


PRESS "RETURH" WITH NO ENTRY WHEN YOU ARE DONE. 
ENTER @ NEW KHOT SET: 


KCl) 
KiZ> 
K¢3> 
} KC4s 





Option 6 causes the following displays while performing the regression: 


PREPARE FQR THE REGRESSION: 


SORTING THE KNOTS INTO INCREASING ORDER: 





eo 


INITIALIZING THE MATRIX @ 
“WORKING” USER DATA INTO Q 
SOLVING THE LINEAR EQUATIONS IN @ 
CALCULATING THE COEFFICIENTS 
CALCULATING R-SGUARE ' 


ae Meee 
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R-SQUARE = 8.987520539213 
STAN DEV = @.248755459987 
ers PRESS "SOLUE" {KEY &7> WHEN YOU WANT A NEW FIT. 


or. 
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_ PRINT PARAMETERS (Key #10) A AO igs ss 


When PRINT PARAMETERS is pressed, the smooth curve equation is printed'in tabular form.” une 7 


PLOT RESIDUALS (Key #18) 
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FOX) = AJ + BIECK-KJ> # CIECK-KUDT2 + DUECK-KUDT3 
FOR KJ <m KX Cm KC SH1) » Sm Agee nag 

FOX) = AL + BIECX-K1> + CIECK-KID42 + DLBCK-KI)43 
FOR xX <= Ki 
















KJ KC J+L> AJ BJ co . 
Q.6080 1.3288 -0.0768 «=. 9006 «1.6128 =1,1124 
1.3200 2.0408 8.9923 1.4924  -@.7984 8499 
2.0408 9.0E+307 1.6758 =. 4319 «+8. 6826 
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- PROGRAM FILE ALLOCATION 


Program Seven is contained on magnetic tape files 28 through 36. 
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Program Eight 


= FOURIER REGRESSION | 


PROGRAM DESCRIPTION 


This program employs two fitting techniques for x, y data pairs. A least squares fit for any x, y 
data set is based on the model: 


¥y = Ao/2 + Ai * COS(T) + Bi * SIN(T) +... + Am * COS(M * T) + Bn * SIN(M * T). 











0 
2m * (X — Xmin) 5 
T = i ee oe ‘ G) 
max min ; 2 
F 4 
If x data values are in evenly spaced ascending sequence, discrete Fourier series coefficients z 
can also be calculated.. The model is the same, except © 
oT * (x = Xmin) 
T= —————— where 
(Xmax — Xmin + H) 
H = thestep size between X; data values. 
~  Foragiven harmonic, M, the least Squares method produces the best possible fit, using sinand 
cos terms. Fourier coefficients, however, are calculated much faster. is 
For N = number of data points, the maximum harmonic allowed for either method is: a 
N-1 a 
INT . - 
3) ¥, 
METHODS x 
The least squares method, using the model previously shown, maps data within the Xmin, Xmax - 
range into the interval 0 to 277. Best results will be obtained when y at Xmin = y at Xmax. Parameters a 
Ao to Bau are found by forming the upper triangular portion of the normal equations, solved by 
the Cholesky (square root) decomposition method. j 
27 * (X — Xmin) oe 
T= ‘> 
(Kings — Xmin Li H) 2 
, Pa) 
jm 
2 
es 
the same model, is used for discrete Fourier series frequency decomposition. Data within the 2 
Xmin ~ Xmax Fange is mapped into interval 0, 277—H. For the Fourier method, they at xmin Should not Le 
_ equal y at Xmax. 9 
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INITIALIZE (Key #1) 


The data pair capacities of your machine are calculated and displayed, with the corresponding 
number of harmonics. An upper limit must be entered to indicate the maximum number of data 
pairs anticipated. 


If the x data points are evenly spaced, minimum x value and step size must be entered. Data can 
then be entered from the keyboard. 





ARE THE K1’°S EVENLY SPACED: YES 
ENTER X MIN AND STEP SIZE = 1.@€-3,0.125 
1 X » 1.0E-3 ENTER Y = -8.1088 
= 6.126 ENTER Y = -.0935 
= 8.251 ENTER Y = -8.0549 


@.376 ENTER ¥ = -0,8836 
8.581 ENTER Y = @.8503 
8.626 ENTER ¥Y = 8.0995 
8.7Si ENTER ¥ = 8.1376 


| 
| 
| 
: 


= 
z 
C 
¢ 
a 
> 
= 
2 
Zz 
m 





Data must contain only one period of the function, as described in METHODS. 


FROM TAPE 


Except for changing tape cartridges and entering the data file number, the FROM TAPE 
procedure is similar to the INITIALIZE procedure. When the taped data file is read into 
memory, any data points previously in memory are destroyed. 


FOURIER REGRESSION 
INITIALIZATION: 
THE NUMBER OF DATA PAIRS YOU CAN HAVE WITH YOUR 32K M@CHINE 
DEPENDS UPON TWO FACTORS: 
1. WHICH METHOD YOU CHOOSE: 
A. FOURIER COEF. METHOD (FOR EVENLY SPACE® DATA ONLY? 
B. LEAST SQUARES METHOD (REQUIRES A LARGE SCRATCH ARRAYS 
2. THE HUMBER OF HARMONICS DESIRED. 





METHOD NO. DATA PAIRS NO. HARMONICS 


FOURIER COEF. 938 
" . 1378 
* ie 1388 
, = 1398 


LEAST SQUARES 448 
. ° 818 
* id 188@ 
- . 1258 


MOTE: WITH FEWER HARMONICS YOU CAN HAVE MORE DATA PAIRS. 


feast ig cme ogee 


a ear ee 


ENTER Al’ UPPER BOUND ON THE HUMBER OF DATA PAIRS = 246 
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KEY #11 i ie" 
INSERT 
DATA | 
TAPE : A 
: © 
. @ 
et i: 
i > 
‘ s 
ENTER FILE NUMBER z 
Zz 
J. 7 : m 
ENTER UPPER BOUND ON 
NUMBER OF DATA PAIRS 
READ DATA FROM TAPE. Ps 
_ o. 
INSERT BN 
PROGRAM a 
TAPE ees 
coo 
es — 
PROCESS DATA. PRESS USER ie + 
DEFINABLE KEYS ° 
3 
: 
4 i : 
Ne ; 
re. 
ase 
x 
a E 
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~ Results are displayed in tabular format as shown. 


F(X? = ABlZ2 + ALECOS(T> + BESSINCT> +... + ABECOSCT? + BESSINCT> 
T © @.0174532925199 *¢ X¥ - @ > 


WHERE 


HARMONIC 
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A <CO0S> 
26. Beeaeseea 
1,80000006 
-5. 8880880 
-6. 898028008 
@,e5eaeaae08 
4,59080008 
~1. 80680006 
-11. 899080088 
-1. 98988088 


‘B <SIN> 

2. 889868068 
1.68880880 
4,eeag0ae0 
1. 50@@8008 
2.68988800 


-11.08899888 


1.808888 
12. 68488886 
28, 02900008 


AMPLITUDE 
28. 899080688 
1.41421356 
6.48312424 
1, 70088800 
2.08062490 
11.88486432 
1,414212356 
16.27882868 
28, 82498439 


PHASE CRAD > 
@. 88888880 
-8. 78539816 
-2. 46685171 
-2.86073363 
-1.54588153 
1,18247761 
-2.35619449 
-2.31274399 
~1.62075472 
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CALCULATE AND DISPLAY RESULTS 
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aS 
_ LOT FUNCTION (Key #8) ae "ae 
When PLOT FUNCTION is pressed, minimum and maximum values are displayed. } a 
When RETURN is pressed, the function is plotted as shown. 7 
FOURIER REGRESSION bi 
| it 
| 
| $6 
a; 
x R.: 
° 
o 
3 
Zz Re. 
z 
EB 
~ ee 
pie 
PROGRAM FILE ALLOCATION ie 
Program eight is stored in files 37 through 41. The correct files are read into memory al 
automatically, as needed. et 
: rR 
9 
ii 
Pb 
‘2 
:Q 
tm 
2 
on 
2) : 
Psi e 
= EE. 
> Ee. 
ia a 
oO TR 
bak 
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VARIABLES—PROGRAM EIGHT 


VARIABLE 


A,B 
M 
M4 


N 
p 
P(4) 


P(3), P(4), P(5), P{6), 
P(7), P(8), P(9), (10) 
P(11) 


P(14) 
P(15) 


P(16), P(17) 

P(19) 

P(23, P(24), P(25), 
P(26) 

PO 

P1, P2, P3, P4, P5, P6, 
P7, P8 

Pg 

P$ 

Q 

Qo 

Q1, Q2, 3, 24, Q5, Q6, 
Q7, Q8 

ag 

Q$ 

x, Y 





PEE AA 22 SA TFT a MN RARE M/S 


USAGE 


The arrays (Length (M+1)) containing the parameters of the fit. 
The largest harmonic chosen for the present fit. 

1 = Coefficients found. 

0 = Coefficients not found. 

The number of user data points. 

A scratch linear array, P(26). 

The maximum number of data pairs that can be stored in the X,Y 
arrays. 


Used for plotting window and labeled axes. 
1 = Evenly spaced data entry. 
2 = Randomly spaced data entry. 
Step size for evenly spaced data. 
A flag 1 = Evenly spaced x; {increasing order). 
0 = Non-evenly spaced. 
Scale factors for transforming x. T = P(16)*(x—P(17)). 
R-Square (goodness of fit) statistic. 


x minimum/maximum, y minimum/maximum for user data. 
(x maximum — x minimum)/QO. 


Scratch. 

Flag to indicate key pressed. 

A string, P$(1), for input of YES/NO responses. 

Q(2M+1, 2M+2) used to hold the normal equations. 

= 490. When the function is plotted, it is drawn as QO line segments. 


Scratch. 

The device address for graphics display. Initialized value = 32. 
Scratch. 

Linear array, X(P(1)), Y(P(1)) holding N x,y data pairs. 
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Program Nine 


~ LINEAR REGRESSIONS 


PROGRAM DESCRIPTION 


This program fits linear regressions of the form Y' = A+ BX’ to xy data pairs. Where Gand F 
represent transformations, y = G(y), and x’ = F(x). Twenty-four transformations, predefined 
by the program, are available for selection fromamenu. Aunique transformation, supplied by 
the user, can be entered into the program. 


This program is especially suitable for determining equations representing tabled or 
experimenta! data. 


Data, transformed or not, can be plotted against the regression line. Various transformation 
combinations can be plotted against each other until the best possible fit is obtained. 


The Regression Equation is as follows: 
G(y) = A+B*F(x), when 


~ 2 _ N*zG(y)*F(X) —F G(y)*ZF (x) 


NaEF(x)  — ZF(x)? ane 


_ XG(y) — B * EF(X) 
a 


Data points (x,y) are operated on by transformations F(x) and G(y) to produce data points 
(F(x), Gfy)). N equals the number of data points. 


Parameter equations are: 


> (A+B+F(x)—-G(y))’ 


R-square = == when oe 
2(G(y)-Gly))’ Fe 
—— EG(y) 
G Ae esata 
(y) Ni 


Mean Absolute Deviation = r | G(y)-A-B*F (x) | /N. 


Maximum Absolute Deviation = MAX | G(y)—A~BFF (x)].- 


- 
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N = number of observations (number of data points); 

F(x) = transformation function for x data; - 
G(y) = transformation function for y data; 

B = slope of linear regression line; and 

A = y axis intercept of regression line. 


During Linear Regressions program execution, User-Definable key usage requires the 
-yboard overlay shown here. 


LINEAR REGRESSIONS 


pe AIT RENS 
{CHANGE DELETE LIST SET 
DATA DATA F(X) & G{Y) SCREEN 


LIST CURRENT ' CURRENT | 
DATA SCREEN , OFFSET | 


a 
aaa 
© 
-” 
- 
«<< 
po 
* 


SHIFT KEYS <* re A 
COLLECTED CURRENT REMOVE REMOVE 
PARAMETER F(X) & GLY) SCREEN OFFSET 


PN334 -3034-01 


PLOT 50 


' FILTEREO + SELECT ‘ SELECT a 
PARAMETER . PARAMETER : FIX} | GIy) i 





DATA ENTRY 


When program 9 has been loaded, a choice of data entry methods is offered by the following 
display. 


LINEAR REGRESSIONS 
TO ENTER DATA PRESS EITHER ; 


ENTER DATA (USER DEFINABLE KEY @1) 
TAPE DATA CUSER DEFINABLE KEY @16, 





When either ENTER DATA or TAPE DATA is used, any data already in memory will be lost. For 
this reason, a safeguard system has been built into the program. Verification entry “Y” is ¢ 
required to prevent inadvertent data destruction. 


—_ 
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~. Data entry technique is illustrated by the operating procedures flow chart. 


ENTER DATA (Key #1) 


LINEAR REGRESSIONS 


VERIFY INPUT OF DATA WITH “¥". ¥ 3 
ENTER (X,Y) DATA PAIRS: ‘ 


ITEM NO. 


NADU AGN = OW OWNAGE GIN 


ee 





1186, 1E6 





DATA TO TAPE 


TAPE DATA (key #16) is also used to save data to magnetic tape data files. The procedure is 
shown by this display, 


DO YOU WANT TO INPUT DATA FROM TAPE ¢I), 
OR SAVE DATA TO TAPE <$)? S 


INSERT DATA TAPE AND THEN ENTER NUMBER OF 
DATA FILE : 19 
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OPERATING PROCEDURES PROGRAM NINE 













LOAD PROGRAM NINE 





DATA FROM TAPE ? KEY #16 





ENTER “I” 














INSERT 
DATA 
TAPE 


ENTER “Y” . 








a 


ENTER X, ¥Y VALUES 








ENTER FILE NUMBER 





READ X, Y DATA VALUES 


PROCESS DATA. PRESS USER 
DEFINABLE KEYS 
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PLOT es 
Initial data plotting is X vs Y on autoscaled axes. The best straight tine is put through the data. 


PLOT (key #6) will provide a plot of the data and the regression curve, G(y) = A + B F{x). If 
transformation has been executed, the transformed data is plotted with the curve. 


Plotting is executed on the device addressed by the value of variable Q9. Unless the Q9 value 
is changed by the user, Q9 = 32 to designate the display screen. 


999888 
799800 
539088 
3939980 
199808 


ts] 
99 29? 495 693 891 


FCM) aU GCY >a 
GCY¥> = -1.15333E+005 + 1£.886609E+883 3 FLX) 


DATA SCREENING 


Screening allows data subsets to be considered during equation fitting. Regressions are then 
performed in the designated subset only, without deleting the remaining data. Low and high 
screen values are entered, and only data pairs whose x values are within these limits are 
considered. 


Screening is controlled by User-Definable keys 14, 4, and 19. SET SCREEN (key #14) will 


require low x and high x screening data values. When both values have been entered, 
SCREENING COMPLETE will be displayed. 


SET DATR SCREENING VALUES 


THPUT LOR X SCREENING OATR VALUE = @ 


AND HIGH X SCREENING DATA VALUE = 125 
SCREENING COMPLETE. 
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Existing screen values are displayed when CURRENT SCREEN (key #4) is pressed. 


4 


CURRENT SCREEN: LOW X = 6 


HIGH X = 125 





REMOVE SCREEN (key #19) causes screen values to revert to their default values, —1.0E300, 
and 1.0E300 respectively. NORMAL SCREEN RETURNED is displayed to indicate completion 
of the NO SCREEN operation. 





After data screening, plots are rescaled to properly display data. 


628 


ie. 


496 


\ 


372 


248 


124 





108 104 188 112 116 128 
FCX> aU GCY)=V 
GCY? = -2505.94149 + 24.83656 2 F(X) 


DATA MODIFICATION 


When data entries have been completed, data can be changed by CHANGE DATA (Key #11); 
deleted by DELETE DATA (Key #12); or added by ADD DATA (Key #2). Data in memory should 
be displayed to determine the data point number of the data to be modified. 


tiie, 


( 
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LIST DATA 
To display data in memory, press LIST DATA (Key #3). 


ITEM NO. 


NOUR GW 
* 


m=O 
eo 


1@ 
11 
{1 
hi 
1 
i 


Pat Ie Pek toy Bee So feet fra pe 
OO “tO Ch GI 

| etal etl el 

BED mt me en ee ee he ee 

HOVONNAU AWN OO 


1980608 





DELETE DATA 





a 
3x 
= 
pie 
ENTER ITEM NUNBER OF DATA POINT TO BE CHANGED. 18 oe 
CURRENT X= 119 AND CURRENT Y = 296 ig 
ENTER NEW X & Y VALUES. 118,324 ey 
ANOTHER? NO ies 
2) 
r 
p=) 
z 
7) 
m 
Zz 
TN 
a?) 
D 
= 
> 
= 
oO 
z 
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PLOT 


The corrected data can be plotted by pressing Key #6. 


628 
496 
372 
248 
124 


Q 
1ae 164 


F(X) aU GCY ay 
GCY) = -2525. 45213 + 


TRANSFORMATIONS 


24, 22473 & FLX 





 ceasnatel form rE eet Gene — 


128 | 


Twenty-four transformations are available from the menu displayed when SELECT F(x) (key { 


#9) is pressed. 


FROM THE TRANSFORMATIONS AT RIGHT 


SELECT FOX) = 


SWOnNHUMS WAI 





LOGY) aU 
LOGY 
17¥ 

1/Ut2 
1/Ut3 
VtTC172) 
Utci73> 
VUtC174> 
SINCY)> 
COS«Us 
ARCSINCY> 
arccascyu> 
SIMHCY) 
COSHCLY> 
TAHHCY)> 
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__ The same selection is available for y transformations when SELECT G(y) (key #10) is pressed. 
To display the existing transformations, press CURRENT F(X) & G(Y) (key #18). 


Transformed values of all x and y data points are displayed when LIST F(X) & G(Y) (key #13) is 
pressed. 


To plot the square root of y versus x, press Key #9 and set F(X) = V by selecting transformation 
#1. G(Y) is set to Vt (1/2) by pressing Key #10 and selecting transformation #13. 





ITEM NG. 


' 
1 
4 
4 





DWUVHUAWN=@D 
WONHUAGN=O 


1 
2 
3 
4 
3 
€ 
? 
8 
9 
1 
1 
1 
i 
1 
1 
1 
1 
{ 
1 
2 
21 
22 
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PLOT (Key #6) will plot the last transformation setting. 


24 


28 


16 


12 


FcR eV 


Gcy) = 


PARAMETERS 


When PARAMETERS (key #7) is pressed, parameters for the last selected transformations are 


displayed. 


128@ 104 


-168,8088@ + 


108 112 


GCYDeUtC172) 


1.00068 * FCX) 


116 


MEAN DEY 


128 


Mad PESIDUAL 
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— FILTERED PARAMETERS 


User-Definable key #8 permits regression screening for satisfaction of unique criteria, 
composed of transformation combinations. R-square greater than a designated value, for 
example; or mean deviation less than a specified level; or maximum absolute deviation less 


nan a certain value. 


PARAMETER FILTERING 
ALL TRANSFORMS USED FOR PARAMETER FILTERING (Ad, 


GR ONLY SELECTED TRANSFORMS (S$)? A 





To filter all possible transformatian pairs, enter A, press RETURN, and enter values for R- 
Square, Mean Absolute Deviation, and Maximum Absolute Residual. To ignore the R-Square 
criteria, enter any number larger than 1. To disregard the Mean Absolute Deviation or the 
Maximum Absolute Residual criteria, enter any negative number. 


SELECT FILTERING PARAMETERS, 


R-SQUARE > 2 


MEAN ABSOLUTE DEVIATION < 1.5 


MAXIMUM ABSOLUTE RESIDUAL < +} 





If only selected transformations are to be used, the selection menu will be displayed. After 
selection is completed for x, enter 0 to terminate the transformation selections. The same 
procedure is then repeated for y transformations. 





Transformations are calculated and transformation combinations satisfying the criteria are 
displayed. 
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OFFSET VALUES 


Offset values can be subtracted in all calculations to effectively change original values. If xo and 
yo are offset values, data pair x,y is replaced by (x-xo}, (y-yo). Subsequent transformations and 
screening will use the modified data values instead of the original data values. User-Definable 
keys 15, 5, and 20 are used to define, display, or rescind offset values. 


SET OFFSET (key #15) requires entry of x and y values, and displays FINISHED when both 
values have been accepted. 


ENTER X OFFSET: 188 
ENTER Y OFFSET: @ 


FINISHED. 





CURRENT OFFSET (key #5) will display existing x and y offset values. REMOVE OFFSET (key 
#20) will set both values to zero, and remove the offset from data values. | 


Screened, offset, and transformed data can be plotted on autoscaled axes with PLOT (Key #6). 


198 
90 
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36 
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8 18 36 34 72 98 


FCX >a GCYIzUtC172) 
G<¥> = 3.95432E-013 + 1.@880@E+808 & FCX> 
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~ COLLECTED PARAMETERS 
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COLLECTED PARAMETER (Key #17) will cause R-Square, Mean Deviation, and Maximum 












































“| 
ae 
Absolute Residual to be calculated and displayed. Calculations are performed for all possible : 
Pe 
transformation combinations or transformation subset combinations. You may select : 
calculations for all or for selected transformations. ; 
Parameters for which R-SQR approaches 1 are the best fit. 
74 
MEAN DEY Max RESIDUAL : 
yy) 5.485968 
y Ute 8.1223 533.495581 757.534758 
y vt3 @. 1882 39266.594471 58569. 193887 
y 17V 8.205 8.882392 8. 693088 
uv i-ute 8.2363 8.608101 8.806138 
u 1-¥t3 8.2678 8.990983 6.800005 
Y SINC 8.2556 8.337370 8.583948 
Y) coscy) 8.4877 0.441751 6.950641 
y SINH(U> 2, 235E~a62 8.832E+023 2. 208E +024 
y COSKCY) 2. 235E-082 8.832E +823 2. 288E +824 
y TANHCU) 8, 988E +387 @. BG0E+a08 8. 898E+G08 
V ety 8.5492 8. eea88e 8. 890808 
v et(-y) 2. 235E-882 1. 766E9824 4.4166 +024 
vt2 v 8.1534 5.145961 9.432376 
ut2 ut2 8.1749 488.247256 862, 3099876 
ut2 Ut3 8.1962 35837. 316075 59699,6450894 
vt2 t-y 8.1130 8.002346 0.804642 
vt2 17Ut2 8.8951 2.280181 8.880209 
ute 1/43 8.8793 6.800083 @. 800007 
ut2 SINC(U) @.1158 8.394781 8.549922 
ut2 COSY) 0.3686 @. 418968 @. 928386 
ut2 SINHC(U> 1.939E-6a1 8.397E+823 1.837E+024 
ut2 COSH(Y) 1.939E-881 8.397E+823 1.8376 +824 
vt2 TANHCY) 8. 988E+3e7 8. @B0E+a8e @. 88GE+eRe 
= ut2 ety 0.0869 8.80800 8.888800 
yt2 et(-Y) 1. 939E~9e1 1,679E+824 3.674E+824 
Utz y -8725 5.551334 8.654218 
Ut3 vt2 8.8515 335.551454 863.554166 
8.8341 39117.823837 65303. 082371 
@.123? 8.802458 8.683587 
8.1520 8.608185 8.808154 
625 transformation types are available. 
ADDITIONAL TRANSFORMATION 
‘ 5 : ; é 
A unique user written transformation function can be added to the transformation menu. The 3 
transformation entry procedure instructions offer a step by step method for adding your F 
transformation to the available selection. . 
oO 
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To prevent alteration of the original program coding, the following procedure is suggested. 


1. Enter number 9 from the program selection menu to read the Linear Regressions program 
into machine memory. 


2. Execute the transformation entry procedure. 

3. Enter data and test the program to verify correctness of your function. 

4. SAVE the modified program to an unused tape file (nn). 

The modified program can then be executed with three commands: FIND nn; OLD; and RUN. 


To add transforms for data already entered, store the data to tape. To use the new 
transformation, initialize the program by entering data from the keyboard or from tape. 


TRANSFORMATION ENTRY PROCEDURE 


Your transformation is entered into the program by modification of existing coding in lines 

1170, 4330, 5030, and 5130. To modify a line: type the line number; press the RECALL LINE key; 

change the coding; and press RETURN. To delete coding, as required in the following 

instructions, use the RUB OUT key on the LINE EDITOR key pad. < 


Coding changes are as follows: 


1170 FO=24 
Change F0=24 to FO=25 


Variable FO defines the number of usable transformations. 


4330 REM DEF FNX(V) = ENTER YOUR FUNCTION HERE. 
Delete ENTER YOUR FUNCTION HERE. 
Enter your transformation to the right of the equal sign. 


Delete REM. 


Line 4330 defines the FNX(V) transformation function. 
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2030 REM DEF FNY(V) = ENTER YOUR FUNCTION HERE. 
Delete ENTER YOUR FUNCTION HERE. 
Enter your transformation to the right of the equal! sign. 


Delete REM. 


Line 5030 defines the FNY(V) transformation function. 


9130 DATA "YOUR TRANS HERE”. 
Delete YOUR TRANS HERE without disturbing the quotation marks. 


Enter your transformation between the quotation marks. 
Line 5130 defines the entry to appear in the transformation SELECT list. Bo ce 


To set transform number 25 to V for F(X) and to V!({1/2) + 100 for G(Y}, lines could be recalled 





and modified as shown. ae. 
os 
ge 
ne, 
FQ=2§ : 
@ Fax25 
OEE DEF FNX(U> = SURES ROBE EB : 
8 DEF timey 2 oe ag QGSs20 BEGE . 
= QU COEF FXYCUD = BEEBE SONS BUSOREES E : 
@ DEF FNYCU) = U7C172)4100 meneen BERG 
DATA "BREE GOQU6 SUED" 
DATA “UtCt7254+106 * fh 
4 
E ow 
$ tal 
‘> 3k 











NOILVWYOINI JONVHD 





50: STATISTICS VOLUME 4 @ 9-15 





SELECT G(Y) = 


FROM THE TRANSFORMATIONS AT RIGHT 


LGTCY) 8 
LGTC(Ud YU 
LOGCU>£U 
LOGCYD/U 
iV 

17Ut2 
1/NT3 
vtciz2> 
Utc173> 
Utc174> 
SINCYD 
cosc«y> 
ARCSINCY> 
ARCCOS(Y) 
SINHC(Y) 
COSH(U) 
TANH(Y) 
ety 
etc-U> 
Ut(172)41B8 


SELECT GC¥) * 25 
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9 
18 
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18 
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transform selected can be plotted by pressing Key #8. 
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—- ERROR MESSAGES 


Error messages generated by the Linear Regressions program are described here. System 


error messages are defined in the 4051 Graphic System Reference Manual. = 
4 

DATA BOUND ILLEGAL Pe 
Calculation of regression coefficients or goodness of fit parameters resulted in an attempt to = 
divide by zero. Add a small x and y offset, or adjust data values. . 
8 
DATA ITEM NUMBER OUT OF BOUNDS Ss 
The CHANGE DATA key was used in an attempt to change a non-existent data point. * 
Pa 
NULL FUNCTION GROUPS SELECTED FOR F(X) OR G(Y). ¥ 
The FILTERED PARAMETER key was used without selection of at least one F(x) and one G(y) 3 
transformation. Press the key again and select transformations. 4 
s 
| 
ILLEGAL TRANSFORMATION SELECTION 4 
~ A number outside the range of available transformations was entered, resulting in selection of ‘ 
a non-existent transformation. Perform the operation again. se 
INPUT ARRAY FULL NO MORE INPUT ALLOWED o 
The number of data points entered has reached the number specified during the program 2 
initialization process. Data points already entered should be saved to magnetic tape before re- x 
execution of AUTO LOAD and initalization. ea 
INPUT PARAMETER ERROR . 
A non-existent data point was specified as the starting or ending number during the DELETE % 

DATA process. 

MUST SELECT F(X) & G(Y) FIRST a 

<= 

The current transformation may have been destroyed by an abnormal interrupt of a i 

PARAMETER operation. Select transformations again before proceeding. ni 

2 

TT 

fa) 

a 

2 

af > 

a 

° 

2 


LOT 50: STATISTICS VOLUME 4 @ 9-17 





9-18 


NO DATA 


This message indicates an empty data array. Use ENTER DATA or TAPE DATA, and enter data 
points. 


NO DATA WITHIN SCREEN 


The range of transformed data points is outside the screen limits. Remove or change the 
screen. , 


NONE 

This message, not indicative of error, occurs during the FILTERED PARAMETER operation. 
Goodness of fit parameters, derived from available transformation pairs, do not meet your 
specified criteria. 


TAPE DATA EXCEEDS MAX. NUMBER OF X,Y DATA POINTS SPECIFIED 


The number of data points read as a result of the TAPE DATA operation is greater than the 
number specified during the AUTO LOAD sequence. To determine how many data points are 
onamagnetic tape file, enter FIND nn (the file number); then enter READ @33:A. The “A” vatue 
will equal the number of data points on the designated file. 
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\ VARIABLES—PROGRAM NINE 
































VARIABLE USAGE 
A The intercept for equations G(Y) = A + BF(X). 
A1,A2 Scratch variables. 
B The slope for equations G(Y) = A+ B F(X). 
C2, C3 Scratch variables. 
D2, D3 Scratch variables. 
D4 Minimum transformed G(Y) value within current screen. 
D5 Maximum transformed G{Y) value within current screen. 
D6 Minimum transformed F(X) value within current screen. 
D7 Maximum transformed F(X) value within current screen. 
FO Number of allowable transformations. PR 
F, FF, F2 Scratch variables. ay t 
F3, F4, F5 Scratch variables. : 
F6, F7 Scratch variables. é 
F$ Scratch string variable. | 
G, G1, | Scratch variables. 
J, K, L,M ; Scratch variables. 
MoO Maximum number of data pairs. 
M2, N Scratch variables. 
NO Number of data points entered. Ei 
4 Number of data points within current screen. 4 
~N2 Scratch variable. : 
N3 Number of data pairs with X = 0 in current screen. 4 
N4 Number of data pairs with Y = 0 in current screen. 4 
P Scratch variable. meee 
Q1 Minimum acceptable R Square value when filtering equations. ieee OS 
Q2 Maximum allowable mean absolute deviation for accepting an cartes 
equation when filtering equations. = “3 
Q3 Maximum allowable absolute residual for accepting an equation wt 
when filtering equations. 8 
Q9 The device address for graphics display. Initialized value = 32. a. 
R1 R Square for a particular equal when filtering equations. 
R2 Mean absolute residual for a particular equation when filtering 
equations. 3 
R3 Maximum absolute residual for a particular equation when filtering _ 
equations. j 
RQ, T Scratch variables. ms 
LAgte Scratch variables. a 
V Scratch variable used to define transformations. > E 
X Array of X values. fn A 
XO X value offset. ze 
Xi Scratch variable. 3 
a a a 
g 
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VARIABLE 


X2 
X3 


X4 
X5 
X6 
X7 
X8 
X9 
X$ 
Y 
YO: 
Y1 
Y2 


Y¥3 


Y4 

Y5 

Y6, Y9 
Y$ 

Z, 21, Z2 
Z$ 
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USAGE 


Array listing transformations to be tried on X values. 

Number of X value transformations to be tried in collected 
parameters or filtered equations. 

Minimum X value within current screen. 

Maximum X value within current screen. 

Scratch variable. 

Minimum value of current X screen. 

Maximum value of current X screen. 

Scratch variable. 

Scratch string variable. 

Array of Y values. 

Y value offset. 

Scratch variable. 

Array containing list of transformations to be tried on Y values in 
collected parameters or filtered parameters. 

Number of transformations to be tried on Y values in collected 
parameters or filtered parameters. 

Minimum Y value of all data pairs with X value within current screen. 
Maximum Y value of all data pairs with X value within current screen. 
Scratch variables. 

Scratch string array. 

Scratch variables. 

Scratch string array. 
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